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SUMMARY 


Pmbiwn 

Hsiiy  stitdmts  entering  military  technical  training  not  only  lack 
effective  reading  skills  and  cognitive  learning  strategies,  but  also 
demonstrate  affective  skill  deficiencies  of  an  attitudinal  or  motiva¬ 
tional  nature.  Although  some  attention  has  been  given  to  programs  that 
remediate  reading  skills,  cognitive  learning  strategies,  and  study  skills, 
little  attention  has  been  given  to  Instructional  packages  that  can  remediate 
those  cognitive  and  affective  strategies  and  skills  related  to  trainee  moti¬ 
vation.  A  val lifted  training  program  could  Improve  the  military  trainees*, 
ability  to  positively  adjust  to  the  requirements  of  military  technical 
training.  It  cottid  also  help  students  develop  a  variety  of  self-management, 
personal  responsibility,  and  self-control  strategies  vihlch  can  Increase 
trainee  motlvatldn,  efficioncy,  And  effectiveness.  Such  Improvements  could 
possibly  reduce  the  high  costs  assoclited  tUth  eliminating  motivationally 
deficient  trainees  after  they  have  completed  sizeable  portions  of  technical 
training,  in  addition,  greater  job  setisfaetlon  on  thf  part  of  trainees 
receiving  the  motivational  skills  training  could  contribute  to  higher  re- 
enlistment  rates. 

Purpose 

This  technical  paper  summarizes  the  historical  background  of  the  Pre- 
Course  Student  Skills  Training  Project  and  describes  the  development  and 


evaluation  of  a  Student  Motivational  Skill  Training  Package  In  a  selected 
Air  Force  technical  training  school.  The  report  also  discusses  various 
Inpllcatlons  of  the  findings,  suggests  areas  of  future  research,  and  con¬ 
cludes  with  reconraendatlons  for  Implementing  the  skill  training  package. 

ApproicH 

Data  for  the  evaluation  of  the  Student  Motivational  Skill  Training 
Package  were  collected  fkom  first  and  second  shift  students  In  the  Precision 
Measurement  Equipment  (PME)  course  at  the  Lowry  Technical  Training  Center  In 
Denver.  Colorado.  Experimental  (second  shift)  and  control  (first  shift) 
groups  of  students,  along  with  a  group  of  Instructors  responsible  for  experi¬ 
mental  group  students  In  the  early  blocks  of  their  computer-managed  technical 
training  course  served  as  subjects.  The  number  of  students  available  for 
evaluation  analyses  In  each  group  ranged  from  11  to  82. 

Students  In  the  experimental  group  received  the  Student  Motivational 
Skill  Training  Package  Immediately  prior  to  beginning  the  first  block  of 
the  PME  course.  This  training  was  conducted  over  a  5  day  period.  5  hours 
per  day.  using  the  technical  training  Instructors  In  the  experimental  group 
as  trainers.  Small  groups  of  10  to  15  experimental  students  received  the 
self- Instructional  seven-module  package,  along  with  Instructor-led  group 
discussions.  During  the  evaluation  period,  a  total  of  seven  groups  of  PME 
students  were  trained  using  the  skill  package.  Students  participating  In 


itfO  took  0Rd*of^dii1t  tostit  which  tcordd  by  the  computer- 
MMilid  tottotoHiMi  (CHI)  systoM  of  the  Air  Foret  Idviiwcid  lAttructlonal 
(Alt).  Allowing  trtfiiliig,  ttudointt  entered  the  first  block  of  the 
FHI  CoiffSiit  ltd  cepptflsoiit  with  cohtrti  group  students  begin. 

HliSuros  used  In  the  eveluetton  of  the  Student  Hotivitlonal  Skill 
Tretnl^  tockide  included:  (a)  oeasures  6f  studento*  knowledge  of  the  concepts 
presiHited  In  the  skill  Modules  (end-of-mo^le  tests.  Oft/post  skill  training 
tests)i  (b)  iieasiires  of  student  attltudei  (end-of^dute  attitude  tests)  and 
opflileM  (anebdetal  Intonaetlen  freu  intervleiii  ahd  dIscUtilons)  about  the 
ttoihlii  peckigOi  and  (e)  fm  ceursd  pei^toNaanCi  Moiailir^t  (block  teat  scores, 
block  titot  fallidre  rates),  instructor  and  couPso  aanademnit  partonnei 
reidktOhS  til  the  package  also  proutd^  a  sburcu  of  aealiiatlon  Ihforiatlon. 
the  AIS  nas  ueed  to  cOtleet  prO/p^t  skill  trdlhlhg  tbit  and  cO#ai  perfor- 
Hliio  intoriialiwi  tor  i>th  Ihperiftentai  oil  aoi^  Hoep 

mm 

U  tm  iPii  of  students'  knoaftedge  of  OencitotS  ppikOntid  in  the  seven 
Iftfll  tratntiig  nodeleSk  ten  neisurito  wiNr  ulidi  Ind^f  iieiieli  test  results 
IHdtcatOd  thet  students  pirtlelpatihl  Id  thl  training  sitisfactorlly  reached 
criliflen  on  all  tests.  Results  on  the  pretest  ihd  posttest,  which  covered 
alt  Savihi  ttodules.  generally  indicated  that.  althOOih  the  groups  did  not 
dlffof  in  pretest  scores,  experlineniai  group  students  hid  higher  scores  on 
the  total  posttest  and  on  the  liaJOrlty  of  module  subsciles  than  did  control 
greup  students.  These  findings  Indicate  that  experimental  group  students 
iueteSsfullp  acgMlred  the  concepts  presented  In  the  Student  Motivational 
Skill  rralhlng  Package. 


In  the  area  of  students'  attitudes  and  opinions  about  the  training 
packages  students'  Initial  attitudes  at  the  end  of  the  training  experience 
and  their  subsequent  attitudes  after  they  were  In  their  technical  training 
course  were  highly  positive.  During  the  training  sessions,  students  In¬ 
dicated  that  they  liked  the  modules,  found  them  useful,  and  were  willing  to 
exert  at  least  moderate  levels  of  effort  to  learn  and  apply  the  concepts 
and  skills  presented.  After  experimental  group  students  were  In  their 
technical  training  course,  they  continued  to  react  positively  to  the 
motivational  skill  training  and  expressed  opinions  that  the  modules  gave 
them  concepts  that  were  helpful  In  their  coursework.  In  getting  ready  for 
studying  the  course  materials  and  taking  tests,  and  In  their  personal  lives. 

The  findings  In  the  area  of  student  course  performance  Indicated  that 
experlmmtal  group  students  had  significantly  higher  block  test  scores  and 
significantly  lower  block  test  failure  rates  than  did  control  group  students. 
These  f1n(11ngs  suggest  that  the  Student  Motivational  Skill  Training  Package 
may  Impacl  variables  related  to  student  attrition  from  technical  training 
(I.e.,  number  of  block  test  failures)— a  suggestion  that  remains  to  be 
verified  by  subsequent  research.  In  addition,  comments  from  PME  Instructors 
and  course  management  personnel  Indicated  that  experimental  group  students 
had  lower  absenteeism,  more  confidence  about  taking  tests,  and  shorter 
lesson  completion  times  than  did  control  group  students. 


iiiaedotal  tnd  qualitative  Infbmatlen  utedl  In  the  evaluation 
tf  11^  tMtt  tralnlni  paekag*  nM  0bta1nq4  fren  dlscusflona  with 

supervisory  personnel  apd  a  United  nunber  of  observations 
pf  bfi^tlor  In  the  learning  center,  nron  these  sources  It  was  learned 

inpliflienlal  group  students  wire  generally  actively  Involved  In  learning 
tkifr  tdchplCat  training  witerlals*  wdft  not  afraid  to  ask  questions,  and 
bad  visible  ^Sltlve  relationships  with  thplr  Instructors  and  fallow  students, 
•llotions  of  supervisory  and  nanagwient  personnel  to  thf  ttudent  Hstlvatlonal 
tklll  training  Package  were  particularly  positive,  they  frit  that  the 
iitiplaU.  fofiiit.  coHceptSi  and  range  of  topics  covered  In  the  package 
ware  Mg|1y  rnlavant.  Supervisory  and  uanagawdnt  pfrsonnil  IP  tha  tlC  course 
bavl  |Sko^  that  the  paclaga  bO  ni^  evellebia  to  all  StUdentl  In  the  course 
10  tN  fhtura. 


The  quantitative  and  qualitative  findings  In  the  evaluation  of  the 
Student  Motivational  Skill  Training  Package  Indicate  that  the  package  met 
Its  goal  of  providing  relevant  pre-course  skill  training.  The  materials 
t*are  positively  received  and  led  to  Improvements  In  the  performance  of  Air 
Force  technical  training  students  In  the  PNE  course.  The  findings  also 
provide  evidence  of  the  feasibility  of  modifying  Individuals'  pre-course 
skills  and  strategies  such  that  motivation  to  perform  well  Is  enhanced. 

The  success  of  the  package  In  a  course  which  selects  mainly  high 
ability  students  with  high  motivation  to  succeed  was  beyond  the  Initial 
expectations  for  this  package.  The  package  had  been  designed  primarily  for 
lower  ability*  less  mature*  and  less  motivated  technical  training  students. 
The  fact  that  It  produced  positive  effects  on  the  performance  of  the  higher 
ability  PNE  student  suggests  that  this  training  package  has  far  wider  appli¬ 
cability  to  the  needs  of  the  technical  training  student  than  was  originally 
envisioned.  This  wider  applicability  appears  In  large  part  to  be  due  to  a 
careful  matching  of  skills  and  strategies  to  the  developmental  needs  and 
age  levels  of  the  students,  to  the  use  of  valid  principles  of  Instructional 
design,  and  to  the  use  of  a  user-oriented  Implementation  strategy.  Any 
subsequent  Implementation  of  the  package  should  use  a  similar  Implenentatlon 
strategy.  The  Implementation  should  Include  user  Inputs  and  decisions  at 
each  of  seven  stages  In  this  semi-structured  process,  thereby  facilitating 
user  acceptance  and  transition  of  the  training  product  to  the  operational 
environment. 
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INTRODUCTION 


Definition  of  the  Problem 


The  application  of  cognitive  and  affective  learning  strategies  in  the 
military  has  been  an  area  of  increasing  concern  since  the  termination  of 
the  draft  in  1972,  A  prevalent  and  continuing  military  problem,  predicted 
by  Vitola  and  Valentine  {1971a,  1971b),  is  that  manpower  resources  from  the 
higher  aptitude  levels  have  become  more  limited  and  the  percentage  of  high 
school  and  college  graduates  is  lower  than  found  during  the  draft.  Recent 
recruits  have  been  found  to  possess  inadequate  basic  reading  skills  (Duffy, 
1977;  Fletcher,  1977;  HumRRO,  1977;  Mockovak,  1974;  Smith,  1980;  Stolte  & 

Smith,  1980),  as  well  as  deficiencies  in  those  cognitive  and  affective 
skills  associated  with  motivational  problems  (Jealous,  Bialek,  Pitpit,  & 

Gordon,  1975;  Joyce,  1980;  McCombs  &  Oobrovolny,  in  press;  McCombs,  Dobrovolny, 
&  Judd,  1979;  O'Neil  &  Spielberger,  1979),  The  nature  of  the  skill-deficient 
recruit's  problem  is  likely  to  include,  then,  a  lack  of  basic  reading  and 
cognitive  skills  coupled  with  motivational  skill  deficiencies. 

There  is  some  evidence  that  motivational  problems  experienced  by  young 
recruits  may  be  of  a  developmental  nature,  Gade  and  Peterson  (1977)  discuss 
the  fact  that  students  at  lower  levels  of  ability— along  with  possessing 
poor  decision-making  and  analytic  skills— also  exhibit  low  levels  of  vocational 
maturity  and  lack  clear  values  and  goals.  One  can  also  speculate  that  given 
the  age  of  the  average  military  trainee  (between  17  and  20  years),  many 
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trainees  are  experiencing  conflicts  typical  of  their  developmental  stage 
(between  adolescence  and  adulthood).  These  conflicts  may  lead  to  affective 
skill  deficiencies  of  an  attitudinal  or  motivational  nature  and  may  con¬ 
tribute  to  the  military  trainee's  inability  to  adapt  to  the  requirements  of 
military  technical  training.  Thus,  skill  deficiencies  In  the  military 
recruit  population  entering  technical  training  may  encompass  skills  In  both 
the  cognitive  and  affective  domains.  Learning  strategies  research  and  appli¬ 
cation  In  the  military  student  population  must  address  both  these  skill 
areas— a  position  In  keeping  with  the  argument  that  affect  and  cognition 
are  Inseparable  yet  distinct  (Hurst,  1980;  Piaget,  1952;  Zajonc,  1980). 

Neither  process  domain  should  be  neglected. 

Project  Background 

Experience  with  the  Air  Force  Advanced  Instructional  System  (AIS)  has 
Indicated  that  many  technical  training  students  entering  this  computer-managed 
Instructional  (CMI)  environment  lack  the  basic  conative  (will  to  learn), 
affective,  and  cognitive  skills  required  to  motivate  themselves  effectively 
and  perform  well  In  their  te:hn1cal  training  courses.  Our  prior  work  for 
Defense  Advanced  Research  Projects  Agency  (DARPA)  In  this  area  Indicated 
that  substantial  payoffs  In  reduced  training  time  can  be  achieved  through 
self-instructional  student  training  In  time  management  and  study  skills.  It 
was  also  learned  that  Instructor  Involvement  and  support  of  such  skill  training 
Is  critical  to  Its  success.  This  earlier  work,  however.  Investigated  only 
a  small  set  of  study  and  self-management  skills  essential  to  effective  and 
efficient  student  performance  In  a  self-directed  technical  training  environ¬ 
ment.  The  effort  discussed  In  this  current  paper  addresses  additional  student 
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skill  training  areas  particularly  tailored  to  the  unique  conative,  affective, 
and  cognitive  skill  deficiencies  of  those  technical  trainees  In  the  lowest 
quartlle  on  course  performance  measures.  This  effort  has  the  potential  of 
Increasing  training  effectiveness  through  Increasing  tr?<nee  motivation 
and  efficiency,  avoiding  the  high  costs  associated  with  eliminating  de¬ 
ficient  trainees  after  they  have  completed  sizeable  portions  of  the  training, 
and  contributing  to  Increased  job  satisfaction  and  thus  to  a  higher  re- 
enlistment  rate  for  trainees  receiving  the  skill  training. 

Goals  of  Project 

This  project  addressed  the  problem  of  student  deficiencies  In  pre¬ 
course  conative,  affective,  and  cognitive  skills  necessary  for  effective 
performance  In  a  computer-based  military  technical  training  environment. 

The  goals  were:  (1)  to  determine  those  types  and  characteristics  of 
trainees  most  In  need  of  Individualized  skill  training;  (2)  to  determine 
the  scope  and  type  of  skill  training  likely  to  have  the  most  payoff  In  the 
conative,  affective,  and  cognitive  skill  domains;  (3)  to  develop  and  eval¬ 
uate  skill  training  materials  In  the  specific  skills  selected  within  each 
domain;  and  (4)  to  develop  and  evaluate  an  Instructor  orientation  package 
to  familiarize  Instructors  with  the  purpose  and  procedures  Involved  In  each 
skin  training  area. 
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This  paper  sumnarlzes  activities  completed  In  the  accomplishment  of 
the  preceding  goals.  The  approach  taken  to  the  Identification  of  specific 
cognitive,  affective,  and  conative  trainee  deficiencies  Is  described  In 
the  following  section  on  Historical  Background,  along  with  use  of  this  In¬ 
formation  to  develop  specialized  skill  training  packages  to  remedy  the 
deficiencies  Identified,  The  remaining  sections  of  the  report  describe 
the  approach  taken  for  the  evaluation  of  the  skill  training  package,  the 
results  of  this  evaluation,  and  conclusions  and  recommendations  based  on  the 
evaluation  findings. 

HISTORICAL  BACKGROUND 

Research  Context 

The  context  for  this  research  program  was  the  Air  Force  Advanced  In¬ 
structional  System  (AIS).  The  AIS  Is  a  prototype,  multimedia,  computer- 
based  Instructional  system  designed  to  Improve  the  effectiveness  and 
efficiency  of  Air  Force  technical  training  and  to  provide  an  operational 
research  facility  for  assessing  Innovations  In  Instructional  technology. 
During  the  period  of  this  research,  the  system  supported  three  technical 
training  courses  representative  of  many  cognitive  and  performance  skills 
required  by  enlisted  Air  Force  personnel.  Military  trainees  learned  their 
respective  course  materials  via  self-paced.  Individualized,  and  computer- 
managed  Instruction  (CMI). 
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The  new  learning  requirements  of  a  CMI  training  environment  make  the 
Inadequacies  of  various  cognitive  and  affective  skills  even  more  apparent 
(McCombs  et.  al.,  1979),  In  a  CMI  environment,  students  are  expected 
(a)  to  be  attentive  and  motivated;  (b)  to  make  learning  materials  meaning¬ 
ful  by  the  appropriate  use  of  learning  strategies  and  skills;  (c)  to  practice 
personal  responsibility  and  self-management  skills  required  for  self-directed 
and  self-paced  learning;  (d)  to  interact  effectively  with  both  their  peers 
and  their  instructors;  and  (e)  to  set  appropriate  course  goals. 

Definition  of  Student  Skill  Training  Needs 

literature  Review.  During  the  first  phase  of  this  effort,  an  extensive 
literature  review  was  conducted  to  identify  student  variables  associated 
with  academic  under-achievement— variables  suggestive  of  the  kinds  of  students 
likely  to  experience  learning  or  motivational  difficulties  in  military 
technical  training.  Research  in  this  area  was  reviewed  from  a  variety  of 
prevalent  theoretical  perspectives,  including  attribution  theory,  information 
processing  theory,  cognitive-behavioral  orientations,  and  theories  of  human 
development. 

First,  those  student  variables  which  were  consistently  Identified  as 
being  Important  to  academic  success  across  the  theoretical  orientations  we 
reviewed  included: 

(1)  students'  level  of  self-esteem  or  self-acceptance; 

(2)  students'  inherent  interest  in  learning  or  intrinsic  motivation; 

(3)  the  extent  to  which  students  have  an  integrated  value  system;  and 

(4)  the  extent  to  which  students  accept  personal  responsibility  for 
learning  and  for  the  events  in  their  personal  lives. 
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Across  the  four  theoretical  orientations  reviewed,  the  Importance  of 
a  student's  ability  to  Implement  effective  coping  skills  (e.g,,  assertiveness, 
stress  management)  and  successfully  adapt  to  and  perform  well  In  stressful 
situations  was  also  emphasized. 

Additional  student  variables  Identified  as  Important  to  achievement 
motivation  and  performance  from  the  perspective  of  attribution  theory  (Bar- 
Tal,  1978;  Covington  &  Omellch,  1979;  Halperin  &  Abrams,  1978;  Thomas,  1979; 
Weiner,  1979,  1980)  Included: 

(1)  students'  perceptions  of  their  locus  of  responsibility  for  academic 
and  personal  successes  and  failures;  and,  concomitantly, 

(2)  students'  feelings  about  the  amount  of  control  they  have  over 
academic  or  life  event  outcomes,  or  the  presence  or  absence  of 
feelings  of  learned  helplessness. 

Other  student  variables  Identified  from  an  Information  processing 
theory  orientation  (Bransford,  Stein,  Shelton,  &  Owens,  1980;  Fransson,  1977; 
Mischel,  1979;  Rogers,  1977;  Sternberg,  1977a,  1977b,  1979;  Williams,  1978; 
Wittrock,  1978,  1979,  1980;  Wittrock  &  Lumsdalne,  1977)  Included: 

(1)  students'  ability  to  Initiate  effectively  and  spontaneously  executive 
processes  and  strategies  that  can  be  applied  to  problem  solving  or 
comprehension  tasks;  and 

(2)  students'  ability  to  execute  effectively  skills  for  dealing  with 
negative  affect  (e.g.,  test  anxiety)  while  engaging  In  information 
processing  activities. 


« 
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The  cognitive-behaviorial  framework  (Bandura,  Adams,  &  Beyer,  1977; 
Berman,  1978;  Ellis,  1977;  Kendall  &  Hollon,  1979;  Mahoney,  1977;  Melchen- 
baum,  1977;  Melchenbaum  &  Asarow,  1979;  Richardson,  1976;  Wool  folk  &  Rich¬ 
ardson,  1978)  Identified  the  Importance  of  the  following  student  variables; 

(1)  the  nature  of  students*  self-verbalizations  regarding  themselves, 
their  abilities,  or  Instructional  factors; 

(2)  students'  beliefs  and  expectations  regarding  learning  situations 
and  their  ability  to  perform  In  these  situations;  and 

(3)  students'  ability  to  cope  with  stressful  situations  through  the 
use  of  such  things  as  assertiveness  or  stress  management  skills. 

From  the  developmental  perspective  (El kind,  1978;  Erlkson,  1968; 
Herrmann,  Post,  Wittmaler,  &  Elsasser,  1977;  Korb  &  Pepin,  1979;  Maslow, 

1954;  Tobacyk,  1978;  White,  1966),  additional  variables  Identified  as 
Important  to  effective  performance  Include; 

(1)  students'  level  of  Intellectual,  emotional,  and  vocational  maturity; 

(2)  students'  commitment  to  meaningful  academic  and  personal  goals; 

(3)  students'  achievement  of  ego  Identity  or  personality  Integration; 
and 

(4)  students'  ability  to  cope  with  and  adapt  to  task  demands. 

Of  the  variables  Identified  In  this  review,  some  can  be  classified  as 
conative,  some  as  affective,  and  some  as  cognitive.  In  the  conative  class 
are  variables  associated  with  motivation  to  learn  (I.e.,  students'  Inherent 
Interest  In  learning  or  Intrinsic  motivation).  In  the  affective  class, 
students'  self-esteem,  values,  goals,  beliefs,  expectations,  attributions. 


and  coping  skills  were  Identified  as  Important  to  Intellectual,  emotional, 
and  vocational  maturity,  as  well  as  to  students'  academic  and  personal  respon¬ 
sibility.  In  the  cognitive  class,  various  executive  processes,  strategies, 
and  skills  were  Identified  as  Important  to  effective  academic  or  personal 
decision-making  or  problem-solving. 

An  examination  of  the  types  of  student  variables  related  to  academic 
achievement  reveals  that  variables  In  the  conative,  or  motivation  to  learn, 
class  directly  or  Indirectly  affect  a  student's  effective  use  of  processes 
and  skills  In  both  the  affective  and  cognitive  domains.  Thus,  as  Covington 
and  Omellch  (1979)  have  argued,  students  need  to  see  themselves  as  both  able 
and  motivated  In  order  to  perform  well.  In  addition,  Maehr  (1980,  p.  5) 
has  stated,  "Not  only  Is  the  motivational  factor  potentially  changeable,  there 
are  the  beginnings  of  technology  that  may  be  successfully  applied  to  the 
real  world  of  the  school." 

Examination  of  AIS  Student  Data.  Two  types  of  data  analyses  were  com¬ 
pleted  1n  order  to  determine  whether  existing  AIS  preassessment  measures 
could  assist  In  defining  the  types  of  technical  trainees  In  need  of  skill 
training  In  three  AIS  courses:  the  Inventory  Management  (IM)  course,  the 
Weapons  Mechanic  (WM)  course,  and  the  Precision  Measuring  Equipment  (PME) 
course.  The  first  type  of  data  analysis  was  concerned  with  determining  If 
cognitive  and  affective  variables  In  each  course's  preassessment  battery 
could  reliably  distinguish  between  those  students  performing  efficiently  and 
effectively.  In  terms  of  course  completion  time  and  cumulative  performance 
scores,  and  those  students  performing  Inefficiently  and  Ineffectively  (I.e., 
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whether  these  variables  could  differentiate  the  fastest/highest  scoring  75 
percent  from  the  slowest/lowest  scoring  25  percent  of  the  students).  The 
second  type  of  data  analysis  was  concerned  with  Identifying  preassessment 
variables  that  were  sensitive  to  specific  student  skill  deficiencies  In  the 
three  skill  domains  (conative,  affective,  cognitive).  The  analysis  procedure 
consisted  of  within-group  (I.e.,  within  the  Inefficient/Ineffective  group) 
multiple  stepwise  regressions,  using  training  time  and  criterion-referenced 
test  scores  as  criterion  variables. 

In  general,  the  data  analyses  suggested  that  In  t.ie  conative  domain, 
unsatisfactorily  performing  students  had  low  Interest  and  motivation  toward 
learning  the  course  materials,  and  thus  could  possibly  benefit  from  skill 
training  In  how  to  motivate  themselves  and  develop  attitudes  of  pride  In 
doing  their  best.  In  the  affective  domain,  the  data  Indicated  that  students 
In  the  unsatisfactory  groups  experienced  high  anxiety  toward  the  course  and 
toward  taking  tests,  and  that  these  students  could  perhaps  benefit  from 
skill  training  In  techniques  for  managing  stress,  anxiety,  or  feelings  of 
tension,  as  well  as  from  attribution  retraining.  In  the  cognitive  domain, 
results  Indicated  that  unsatisfactory  performance  groups  had  poor  logical 
reasoning,  reading  comprehension,  and  study  skills  and  could  possibly 
benefit  from  skill  training  In  logical  reasoning  and  problem  solving  tech¬ 
niques,  as  applied  to  both  technical  learning  problems  and  personal  problems. 
In  addition,  data  showed  that  more  females,  younger  students,  and  students 
with  less  educational  experience  were  In  the  unsatisfactory  performance 
groups;  they  might  benefit  from  skill  training  to  enhance  maturity,  personal 
responsibility,  and  effective  communication. 


student  and  Instructor  Interviews.  Interviews  with  AIS  students  and 


Instructors  In  the  IM,  WM,  and  PME  courses  were  conducted:  (1)  to  ascertain 
their  perceptions  of  the  characteristics  which  distinguish  students  performing 
well  versus  poorly;  (2)  to  Identify  their  perceptions  of  the  problems  students 
have  with  the  course  and  their  strategies  for  coping  with  these  problems; 
and  (3)  to  solicit  suggestions  on  the  types  of  skill  training  they  felt 
would  be  most  beneficial. 

Results  of  these  Interviews  Indicated  that  the  kind  of  students  having 
the  most  difficulty  in  successfully  completing  their  courses  were  those  who 
exhibited  the  following  characteristics: 

(1)  In  the  conative  domain,  the  poorer  students  consistently  were  those 
who  had  low  motivation  to  learn,  had  few  military  or  personal  goals, 
and  could  be  classified  as  being  less  mature,  with  little  self- 
discipline  and  unable  to  take  responsibility  for  their  own 
learning. 

(2)  In  the  affective  domain,  the  poorer  students  were  generally  those 
who  had  high  levels  of  anxiety  about  their  ability  to  perform  well 
In  the  course  and  to  take  tests,  and  who  lacked  effective  skills 
for  coping  with  the  denands  of  technical  training. 

(3)  In  the  cognitive  domain,  the  poorer  students  were  generally  those 
with  poor  reasoning  and  comprehension  skills,  or  those  who  lacked 
problem  solving  skills  In  technical  and/or  personal  areas. 

Areas  of  skill  training  suggested  by  the  Interviews  Included: 
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(1)  In  the  conative  domain,  training  In  skills  necessary  to  the  develop¬ 
ment  of  personal  and  vocational  maturity  was  suggested,  along  with 
training  In  skills  necessary  to  establish  and  maintain  motivation 

to  learn  (e.g.,  values  clarification,  career  exploration,  goal 
setting), 

(2)  In  the  affective  domain,  suggested  skill  training  areas  Included 
those  designed  to  promote  students'  management  of  relevant  sources 
of  stress  (e.g.,  test  anxiety)  and  training  In  skills  for  achieving 
positive  self-control  In  other  types  of  stressful  situations  (e.g., 
effective  cottmunl cation  skills). 

(3)  In  the  cognitive  domain,  training  In  general  systematic  thinking 
and  problem  solving  skills  was  suggested. 

Development  and  Validation  of  Individual  Difference  Battery 

Based  on  the  results  of  the  literature  review,  AIS  student  performance 
analyses,  and  Instructor  and  student  Interviews,  a  set  of  Individual  differ¬ 
ence  measures  was  selected  from  available  measures,  or  designed  by  the  con¬ 
tractor  where  satisfactory  measures  did  not  exist.  In  general,  the  measures 
were  designed  to  assess  students'  (a)  personal  values  and  goals;  (b)  emotional 
or  psychological  and  vocational  maturity;  (c)  self-concept  or  self-esteem; 

(d)  expectations  about  the  demands  of  the  military,  technical  training,  or 
responsibility  for  their  own  learning;  (e)  perceptions  of  their  ability  to 
deal  with  various  sources  of  stress;  (f)  ability  to  make  responsible  deci¬ 
sions  (be  assertive);  (g)  achievement  motivation  or  fear  of  failure; 
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(h)  success/failure  attributions;  (i)  learning-related  self-verbalizations; 
and  (j)  problem  solving  or  critical  thinking  skills. 

The  resulting  battery  of  140  items  was  validated  to  identify  the  smallest 
set  of  items  which  could  (a)  reliably  discriminate  satisfactory  and  unsatis¬ 
factory  performance  groups  in  two  AIS  courses  (the  IH  and  PME  courses);  and 
(b)  define  particular  skill  training  strategies  or  treatments  for  those 
students  performing  unsatisfactorily.  The  conclusions  were: 

(1)  a  reduced  subset  of  80  items  formed  30  factors  which  are  both 
reliable  (internally  consistent)  and  predictive  measures  of  the 
kinds  of  trainees  performing  satisfactorily  or  unsatisfactorily 
in  a  CMI  military  technical  training  environment; 

(2)  the  resulting  30  factors  form  theoretically  and  conceptually  mean¬ 
ingful  constructs  suggestive  of  possible  trainee  skill  deficiencies 
and  skill  training  needs  In  the  areas  selected;  and 

(3)  the  validation  process  yielded  a  set  of  factors  that  can  be  further 
evaluated  in  terms  of  their  predictive  and  diagnostic  utility  in 
assigning  selected  motivational  skill  training  materials  developed 
as  part  of  this  project. 

Definition  of  Student  Motivational  Skill  Training  Package 

As  a  first  step  in  the  definition  of  the  student  motivational  skill 
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training  modules  developed  in  this  project,  literature  related  to  treat¬ 
ment  approaches  and  behavior  maintenance  approaches  was  reviewed.  Potentially 
effective  strategies  and  procedures  for  remedying  skill  deficiencies  were 
identified. 

Selective  review  of  cognitive  behavior  modification  approaches  to 
treating  skill  deficiencies  related  to  motivation  to  learn  identified  a  num¬ 
ber  of  approaches  which  have  been  successfully  used  to  alter  cognitions, 
feelings  or  performance.  The  most  successful  approaches  were  those  that 
emphasized  cognitive  restructuring,  the  modification  of  dysfunctional  self¬ 
talk,  cognitive/behavioral  modeling,  and  behavioral  rehearsal  (Block,  1978; 
Oeffenbacher,  Mathis,  &  Michaels,  1979;  Deffenbacher  &  Parks,  1979;  Deffenbacher 
&  Shelton,  1978;  Ellis,  1977;  Galassi  &  Galassi,  1978;  Goldfried  &  Davison, 

1976;  Goldfried,  Linehan,  &  Smith,  1978;  Lange  &  Jakubowski,  1976;  Mahoney, 

1977;  Mahoney,  Moore,  Wade,  i  Maura,  1973;  Meichenbaum,  1972,  1975,  1977; 
Meichenbaum  &  Goodman,  1971;  Mischel,  1979;  O'Neil  &  Richardson,  1978;  Rathus, 
1973;  Richardson,  1976;  Snyder  &  Deffenbacher,  1977;  Vorwerg,  1977;  Wolfe  & 
Fodor,  1977;  Wool  folk  &  Richardson,  1978).  These  approaches  were  successful 
in  such  areas  as  (a)  promoting  self-identity  and  helping  people  feel  better 
about  themselves;  (b)  increasing  people's  perceptions  of  the  amount  of  control 
they  have  over  situations  or  events  and  their  feelings  of  responsible  self- 
control;  (c)  helping  people  acquire  strategies  for  successfully  coping  with 
stress  in  a  variety  of  situations;  and  (d)  assisting  people  to  assert  them¬ 
selves  more  effectively  and  achieve  desired  goals. 


The  review  of  cognitive  behavior  modification  approaches  to  skill 
maintenance  following  initial  training  or  treatment  indicated  that  techniques 
which  have  been  successfully  used  include  various  combinations  of  self- 
monitoring/self-assessment  with  self-reinforcement  (Carter-Haar,  1978;  Greiner 
&  Karoly,  1976;  R.  Hart,  1978;  Highlen  &  Voight,  1978;  Judd,  McCombs,  & 
Dobrovolny,  1979;  Kirschenbaum  X  Karoly,  1977;  Komaki  &  Dore-'Jayce,  1978; 
Krumboltz  &  Shapiro,  1979;  Myers,  1978,  O'Neil  &  Richardson,  1978;  Rathus, 

1973;  Richards,  McReynolds,  Holt,  &  Sexton,  1976;  Richardson,  1976;  Sagotsky, 
Patterson,  &  Lepper,  1978;  Woolfolk  &  Richardson,  1978;  Ziesat,  Rosenthal,  & 
White,  1978).  The  techniques  used  in  self-monitoring  include  personal  diaries, 
journals,  logs,  note  cards,  graphs,  progress  charts,  and  other  record  keeping 
procedures  that  require  individuals  to  frequently  evaluate  and  record  positive 
and  negative  instances  of  the  skills  and  behaviors  in  question.  In  addition, 
goal  setting  has  been  found  to  be  effective  in  enhancing  individuals'  moti¬ 
vation  to  monitor  and  assess  their  behavior  or  psychological  processes.  Self¬ 
reinforcement  techniques  include  engaging  in  positive  self- talk  when  desired 
outcomes  are  attained,  recording  self-ratings  on  the  effectiveness  of  their 
skills,  and  identifying  and  applying  extrinsic  rewards  when  certain  skills 
and  behaviors  have  been  succeiisfully  implemented. 

An  integration  of  these  findings  with  the  results  of  analyses  of  trainee 
skill  deficiencies  in  the  AIS  context  resulted  in  the  identification  of  seven 
skill  training  modules  to  be  included  as  part  of  the  Student  Motivational 
Skill  Training  Package.  These  modules  are;  Introduction,  Career  Exploration, 
Values  Clarification,  Goal  Setting,  Effective  Communication,  Stress 
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Management,  and  Problem  Solving.  These  modules  were  designed  specifically 
for  those  students  performing  unsatisfactorily  In  the  three  AIS  courses.  The 
seven  modules  are  Individually  packaged  In  a  self-instructional  printed  format 
which  makes  extensive  use  of  visual  organizers,  embedded  questions,  practice 
exercises,  and  a  variety  of  the  treatment  and  skill  maintenance  approaches 
Identified  In  the  preceding  literature  review.  In  addition,  an  Instructor 
orientation  and  training  package  Is  Included  as  part  of  this  total  program, 
now  given  the  general  title  of  "Motivational  Strategies  for  Positive  Self- 
Control  and  Development."  The  following  sections  provide  a  brief  description 
of  each  of  the  seven  modules  In  the  student  package,  and  the  Instructor 
orientation  and  training  package. 

Introduction  Module.  A  substantial  body  of  research  has  shown  that 
various  types  of  advance  organizers  can  significantly  Improve  a  reader's 
ability  to  Integrate  and  comprehend  Information  (e.g.,  Felker  &  Dapra,  1975; 
Kaplan  &  Simmons,  1974;  Mayer,  1975,  1979;  Wittrock,  1978,  1980).  For  the 
student  package,  then,  an  Introductory  module  which  details  the  objectives 
and  general  perspectives  of  the  skill  training  was  designed.  Information 
which  was  felt  to  be  Important  for  students  to  understand  as  part  of  taking 
positive  self-control  and  personal  responsibility  for  their  own  learning  and 
lives  Included  Maslow's  hierarchy  of  needs,  the  self-fulfilling  prophecy  and 
the  use  of  self-talk  and  imagination  In  gaining  positive  attitudes  and  be¬ 
haviors,  being  their  own  coach,  practicing  Imagination,  and  the  steps  In¬ 
volved  In  controlling  or  changing  negative  attitudes  and  beliefs. 


Values  Clarification  Module.  The  purpose  of  values  clarification. 


according  to  G.  Hart  (1978),  is  educational  and  such  training  is  usually 
designed  to  help  individuals  identify  important  values  in  their  lives  and  to 
explore  how  their  various  values  combine  into  a  value  system.  Students  are 
given  a  number  of  exercises  to  help  them  analyze  what  is  important  to  them 
in  the  following  areas:  Other  people  and  values;  leisure  time  and  values; 
personal  traits  and  value,.;  'cligion,  race,  and  values;  sex,  marriage, 
children,  and  values;  values  as  goals  for  life;  clothes  and  values;  and 
sharing  their  values  with  others. 

Career  Exploration  ftodule.  Research  within  the  vocational  or  career 
development  field  reveals  three  important  findings  relative  to  this  type  of 
training.  First,  deficiencies  in  vocational  maturity  can  be  ameliorated  in 
a  short  amount  of  tim.;  and  in  so  doing,  individuals  often  Increase  their 
motivation  (Egner  &  Jackson,  1978;  Galassi  &  Lemmon,  1978;  Hamdani,  1977; 
Stephenson  &  Hunt,  1977).  Second,  the  most  successful  training  programs 
in  this  area  often  combine  informatio  .  about  occupations  with  some  type  of 
interest  and  values  clarification  exercises  (Connors  S  Pruitt,  1978;  Egner 
X  Jackson,  1978;  Hamdani,  197,;  Rayman  X  Bowlsbey,  1977;  Tichenor,  1977). 

Third,  several  successful  programs  have  shov/n  that  increases  in  vocational 
maturity  are  retained  over  time  (Galassi  X  Lemmon,  1978;  Hamdani,  1977).  Thus, 
this  module  was  developed  to  provide  students  with  information  on  how 
interests  are  related  to  careers  and  how  to  identify  careers  they  may  want 
to  pursue  on  the  basis  of  completing  Holland's  Self-Directed  Search  (Holland, 
1974).  The  module  also  helps  students  use  a  decision  making  model  in  making 


career  decisions.  Other  Important  concepts  presented  In  the  module  Include 
(a)  the  difference  between  a  good  decision  and  a  good  outcome;  (b)  the  In¬ 
fluence  of  parents  on  career  decisions;  (c)  the  Importance  of  hobbles  and 
leisure  activities  In  making  career  decisions;  (d)  the  use  of  the  Guide  for 
Occupational  Exploration  and  the  Dictionary  of  Occupational  Titles  to  complement 
Information  learned  about  their  career  Interests  from  Holland's  Self-Directed 
Search;  (e)  how  to  evaluate  risks  and  costs;  (f)  how  to  make  realistic  plans; 
and  (g)  the  use  of  Imagination  and  positive  self-talk  In  making  career 
decisions  and  plans. 

Goal  Setting  Module.  Teaching  students  how  to  set  goals  helps  them 
develop  self-motivation  skills  and  skills  for  monitoring  and  maintaining  newly 
acquired  self-management  skills.  Rosswork's  (1977)  research  In  this  area 
seems  to  Indicate  that  goal  setting  Is  an  effective  maintenance  strategy  due 
to  the  fact  that  If  goals  are  consciously  accepted,  they  maintain  behavior 
at  a  given  level  regardless  of  Incentive  manipulations.  The  purpose  of  goals 
as  directing  and  motivating  human  behavior  Is  presented  In  this  module,  along 
with  the  following  concepts  In  a  systematic  approach  to  setting  goals;  (a) 
the  skill  of  questioning;  (b)  the  use  of  Imagination  and  self-talk  In  setting 
goals;  (c)  the  technique  of  brainstorming;  (d)  the  criteria  for  effective 
goal  statements;  (e)  the  Importance  of  preliminary  activities  In  setting 
goals;  (f)  the  Importance  of  contracts  In  setting  goals;  and  (g)  the  Importance 
of  evaluation  In  setting  and  achieving  goals. 
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Stress  Management  Module.  Dr.  Roy  W,  Menninger,  president  of  the  flennln- 
ger  Foundation,  has  noted  that  some  stress  is  "absolutely  vital"  to  people's 
lives  and  that  the  problem  is  not  to  do  away  with  stress  but  to  "manage  its 
excesses"  (Menninger,  1980).  Other  researchers  (e.g.,  McCombs-Leherissey, 

1972;  Sieber,  O'Neil,  &  Tobias,  1977;  Spiel berger,  1966,  1975)  have  noted 
that  stress  in  moderate  amounts  can  be  facilitative  and  improve  an  individual's 
task  performance,  whereas  in  larger  amounts  stress  becomes  debilitative  and 
detrimental  to  task  performance.  This  curvilinear  relationship  appears  to 
hold  up  regardless  of  whether  one  is  dealing  with  physical /motor  tasks  or 
with  cognitive  tasks  (Spiel berger,  1975).  The  purpose  of  the  Stress  Manage¬ 
ment  module  is  to  explain  how  stress  operates  in  their  lives,  identify  the 
major  sources  of  stress,  and  present  a  variety  of  strategies  for  effectively 
managing  excessive  stress.  The  important  concepts  in  this  module  include: 

(1)  a  definition  of  stress;  (2)  an  explanation  of  the  perceptual  basis  of 
stress;  (3)  the  difference  between  good  and  bad  stress;  (4)  the  importance 
of  mistaken  beliefs  in  precipitating  stress;  (5)  the  Do,  Think,  Say  method 
for  managing  stress;  (6)  ineffective  methods  for  handling  stress;  and  (7) 
the  importance  of  using  some  -ype  of  skill  maintenance  strategy  to  insure 
that  stress  management  skills  become  a  permanent  part  of  the  students'  be¬ 
havior. 

Effective  Communication  Module.  Effective  assertive  communication  is 
being  able  to  communicate  one's  opinions,  thoughts,  needs,  and  feelings  in 
a  direct,  honest,  and  appropriate  manner  (Lange  &  Jakubowski,  1976).  It 
includes  being  able  to  distinguish  assertiveness  from  both  nonassertiveness 
and  aggressiveness.  The  purpose  of  the  Effective  Communication  module  is  to 
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provide  students  with  another  technique  to  help  them  achieve  their  goals 
and  manage  stress  caused  by  Interpersonal  situations.  The  important  concepts 
of  this  module  include;  (1)  the  definition  of  effective  communication;  (2) 
the  difference  between  assertive,  nonassertive,  and  aggressive  styles  of 
communication;  (3)  reasons  for  acting  nonassertively  and  aggressively;  (4) 

10  basic  rights  that  all  people  have  and  the  mistaken  beliefs  that  people 
have  about  these  rights;  (5)  the  use  of  "you"  messages  versus  "I"  messages; 

(6)  effective  listening  skills;  (7)  changing  Ineffective  communication 
skills  to  effective  ones;  and  (8)  the  use  of  a  variety  of  strategies  for 
maintaining  effective  communication  skills. 

Problem  Solving  Module.  Robert  Sternberg  {1977a,  1977b)  hypothesizes 
that  there  are  two  levels  of  information  processing.  The  first  is  the  level 
of  "components"  that  underlie  intelligence— the  steps,  conscious  or  uncon¬ 
scious,  that  one  goes  through  when  one  actually  solves  a  complex  Intellectual 
task.  The  second  is  the  level  of  "metacomponents"  or  higher  order  executive 
processes — the  steps  that  one  goes  through  when  one  decides  how  to  solve  an 
intellectual  problem.  It  is,  moreover,  these  metacomponents  which  many 
researchers,  including  Sternberg,  believe  differentiate  high  ability  students 
from  low  ability  students.  In  other  words,  the  most  important  part  of  problan 
solving  is  structuring  the  problem,  rather  than  performing  the  operations 
for  arriving  at  an  answer  that  is  dictated  by  the  structure  of  the  problem. 
This  module,  therefore,  was  designed  to  describe  a  general  problem  solving 
process  for  helping  students  systematically  think  problems  through  and 
structure  them  in  definable  and  solvable  ways.  The  module  also  provides  a 
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summary  of  the  Student  Motivational  Skill  Training  Package  in  terms  of  pro¬ 
viding  possible  solutions  to  the  problem  of  poor  student  performance  in 
technical  training.  The  Important  concepts  presented  in  this  module  Include: 
(1)  the  steps  in  the  problem  solving  process;  (2)  the  difference  between, 
and  the  futility  of,  retreating  from  or  denying  problems;  (3)  the  importance 
of  incubation  in  solving  problems;  and  (4)  how  the  developmental  tasks  of 
the  target  population — namely,  military  technical  training  students — can 
be  successfully  achieved  by  learning  the  skills  presented  in  this  program. 

APPROACH 

Rationale  for  Data  and  Procedures  Used  in  Evaluation 


Evaluation  Measures.  The  goal  of  the  evaluation  of  the  Student  Moti¬ 
vational  Skill  Training  Package  was  to  measure  its  impact  on  student  perfor¬ 
mance  in  a  CMI  military  technical  training  environment.  The  variables 
selected  as  indicative  of  student  performance  were  (a)  end-of-block  criterion 
test  scores  (a  block  is  a  unit  of  instruction  composed  of  from  5  to  50 
lessons),  and  (b)  failure  n.te  per  block  (number  of  students  who  failed 
specific  block  tests  on  the  first  attempt).  Although  it  would  have  been 
desirable  to  examine  training  time  data,  factors  affecting  the  reliability 
of  this  information  during  the  evaluation  period  prohibited  use  of  these 
data.  In  addition,  the  length  of  time  for  the  evaluation  period  allowed  for 
collection  of  reliable  course  performance  information  in  only  the  first  two 
blocks  of  the  course,  making  comparisons  of  course  eliminations  impossible. 
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Two  other  sets  of  measures  were  used  1n  the  evaluation  of  the  skill 
training:  end-of-modul e  tests  and  pre/post  skill  training  tests.  Both  sets 
of  measures  were  designed  to  assess  the  degree  to  which  students  In  the 
experimental  group  learned  the  major  concepts  presented  In  the  training 
package.  In  the  case  of  the  pre/post  tests,  these  measures  were  also  used 
to  assess  changes  in  knowledge  level  for  the  experimental  students  relative 
to  the  control  students. 

It  would  also  have  been  desirable  to  measure  changes  or  Improvements 
In  the  actual  skills  addressed  by  the  Student  Motivational  Skills  Training 
Package.  Directly  measuring  changes  in  the  skills  addressed  by  a  particular 
learning  strategies/skill  training  package--whether  these  be  cognitive, 
affective,  or  conative  skills— Is  a  difficult  task  at  best.  Although  It 
Is  possible  to  analyze  and  define  the  underlying  processes  and  skills 
necessary  In  such  areas  as  values  clarification,  career  exploration,  goal 
setting,  effective  communication,  stress  management,  or  problem  solving, 
such  an  effort  was  beyond  the  scope  of  this  contracted  research  program. 
Students'  ability  to  successfully  complete  various  segments  of  the  military 
technical  training  course  was,  therefore,  considered  the  most  Important 
criterion  of  the  success  of  the  training  package  In  this  context. 

Data  Collection  Procedures.  Because  of  the  contractor's  location  at 
Lowry  AFB  (the  site  of  the  AIS)  data  collection  and  analysis  activities 
were  accomplished  directly  by  the  contractor  or  the  computer,  with  a  minimum 
of  school  personnel  support.  In  addition,  anecdotal  data  were  collected  In 
the  form  of  Instructor  comments  and  written  student  critiques  of  the 
training  package. 
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Experimental  Design  and  Procedures.  The  experimental  design  selected 
for  the  evaluation  study  was  a  matched  control  group  design,  wherein  the 
group  of  second-shift  instructors  and  students  selected  for  training  in  the 
use  of  the  Student  Motivational  Skill  Training  Package  were  matched  with  a 
group  of  control  instructors  and  students  from  the  first  shift.  Both 
experimental  and  control  instructors  were  those  who  were  responsible  for 
lower  blocks  in  the  PME  course,  i.e..  Blocks  1  through  6.  The  first  shift 
control  group  of  students  received  their  technical  training  via  the  AIS  in 
the  PME  course  from  6  a.m.  until  noon,  ftonday  through  Friday.  The  second 
shift  experimental  grrup  of  students  received  their  technical  training  via 
the  AIS  in  the  PME  course  from  noon  until  6  p.m.,  Monday  through  Friday. 

The  selection  of  shifts  and  the  selection  of  instructors  and  students 
for  the  experimental  and  control  groups  was  left  up  to  school  supervisory 
personnel.  These  personnel  made  their  choices  on  the  basis  of  manning  require 
ments,  instructor  leave  requests,  instructor  tour  lengths,  availability  of 
student  carrels  in  the  first  block  of  the  course,  and  other  variables 
important  for  school  operaticn  end  for  insuring  comparability  in  experimental 
and  control  groups.  School  supervisory  personnel  also  made  an  attempt  to 
restrict  the  number  of  students  who  had  prior  service  experience  from 
participation  in  the  Student  flotivational  Skill  Training  Package,  as  the 
training  program  was  designed  mainly  for  younger  students  with  no  prior 
service  experience.  In  some  cases,  however,  students  with  prior  experience 
were  assigned  the  training  either  because  they  requested  it  or  because  school 
supervisory  personnel  determined  that  they  could  benefit  from  such  training. 


Training  of  students  in  the  use  of  the  Student  Motivational  Skill  Train¬ 
ing  Package  was  accomplished  by  technical  training  instructors.  Bringing 
in  outside  trainers  was  seen  as  creating  an  artificial  situation  which 
could  compromise  the  general izabil ity  of  the  evaluation  findings,  and  would 
also  limit  the  amount  of  assistance  students  could  be  given  in  applying 
skills  learned  while  in  the  technical  training  environment. 

The  Inventory  Management  (IM)  course  was  originally  scheduled  to  be 
the  second  course  involved  in  the  summative  evaluation  of  the  student  skill 
training  package.  Because  of  instructor  manning  shortages,  however,  this 
course  had  to  be  withdrawn  from  the  evaluation  study.  Given  that  the  PHE  course 
was  at  this  time  the  only  other  testbed  available,  it  became  the  evaluation 
site  for  both  this  study  and  another  research  project  being  conducted  by  the 
contractor.  This  other  project  was  entitled  the  CMI  Instructor  Role  Training 
Program,  a  project  jointly  funded  by  the  Navy  Personnel  Research  and  Develop¬ 
ment  Center  (NPRDC)  and  DARPA.  The  CMI  Instructor  Role  Training  project 
involved  having  instructors  complete  a  12-module  training  course  on  the  roles 
and  responsibilities  of  CMI  instructors,  and  it  was  decided  that  the  in¬ 
corporation  of  the  Student  Motivational  Skill  Training  Package  as  part  of 
instructor  training  in  their  learning  facilitator  roles  would  efficiently 
accomplish  instructor  orientation  and  training  requirements  for  this  project. 
This  procedure  necessarily  confounds  evaluation  results,  however,  and  makes 
it  impossible  to  separate  effects  due  to  the  instructor  versus  student 
skill  training  materials.  In  discussing  the  findings,  however,  every  effort 
will  be  made  to  discuss  the  potential  impact  of  the  individual  programs 
where  appropriate. 


General  Procedures 


The  evaluation  of  the  Student  ftotivatlonal  Skill  Training  Package  was 
conducted  In  two  parts:  a  formative  evaluation  and  a  summative  evaluation. 

The  purpose  of  the  formative  evaluation  was  to  obtain  suggestions,  critiques, 
and  comments  from  potential  users  of  the  materials  and  to  provide  the  users 
with  an  avenue  for  constructive  and  significant  Input  Into  the  training 
materials.  The  purpose  was  also  to  obtain  feedback  on  the  extent  to  which 
the  materials  achieved  the  goals  they  were  designed  to  meet.  In  a  clear 
and  non-confusing  manner.  Formative  evaluation  was  conducted  with  Instructors 
and  students  from  the  IM  course.  The  procedures  for  this  evaluation  were 
Informal:  the  contractor  attended  a  staff  meeting,  explained  the  program, 
and  then  asked  for  Individuals  to  volunteer  to  critique  the  materials  and  to 
give  a  module  to  one  of  their  students  for  critique.  The  first  module,  the 
Introduction,  was  then  handed  out  to  the  Instructor  volunteers.  One  week 
later  the  contractor  returned,  picked  up  the  first  set  of  module  critiques, 
and  distributed  the  second  module.  This  procedure  continued  until  all  but 
the  Problem  Solving  module  had  been  critiqued.  Due  to  scheduling  and  In¬ 
structor  manning  problems,  the  Problem  Solving  module  was  subjected  only 
to  an  In-house  review  by  contractor  personnel  assisting  In  this  effort. 

As  a  result  of  this  formative  evaluation,  the  following  changes  were  made: 

(a)  a  glossary  of  key  words  was  added  to  the  back  of  each  module;  (b)  sev¬ 
eral  of  the  modules  were  expanded,  revised,  and  clarified;  (c)  numerous 
diagrams,  graphics,  and  charts  were  added,  revised,  or  clarified;  and  (d) 
some  of  the  worksheets  and  other  maintenance  strategies  were  modified  or 
revised. 
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The  primary  purpose  of  the  summative  evaluation  was  to  measure  the 
effectiveness  of  the  Student  flotlvatlonal  Skill  Training  Package  In  terms 
of  l.nprovenents  In  student  performance.  The  first  step  In  this  evaluation 
was  to  train  the  trainers — the  PME  lower  block  military  technical  training 
Instructors  from  the  experimental  group.  (See  the  section  entitled  Training 
Procedures,  beginning  on  page  27,  for  a  description  of  this  training.) 

Once  the  Instructor  training  was  completed,  a  schedule  was  established  by 
PME  school  supervisory  personnel  such  that  every  instructor  would  have  an 
opportunity  to  be  responsible  for  one  training  class  of  students.  These 
training  classes  contained  between  10  and  15  technical  training  students 
just  beginning  the  PME  course,  with  each  class  lasting  approximately  6 
hours  per  day  for  4  to  5  days. 

Measures 


During  the  skill  training  portion  of  the  summative  evaluation,  two  sets 
of  measures  were  used  to  evaluate  students'  knowledge  of  concepts  presented 
In  the  skill  modules.  The  first  set  of  measures  was  the  end-of-modul e  tests 
which  students  took  after  reading  each  of  the  seven  modules  In  the  training 
package.  Each  of  these  module  tests  consisted  of  five  multiple-choice 
cognitive  Items  and  three  multiple-choice,  scalar  response  affective  Items. 
The  cognitive  Items  were  designed  to  measure  the  students'  knowledge  of  the 
concepts  presented  in  the  module  and  the  affective  items  were  designed  to 
measure  the  students'  overall  impression  of  each  module  and  their  opinions 
about  the  readability  and  utility  of  each  module.  (Copies  of  the  seven 
module  tests  can  be  found  In  Appendix  A.) 
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The  second  set  of  measures  used  to  assess  success  of  the  training 
modules  in  helping  students  acquire  new  knowledge  about  major  concepts  in 
the  package  was  the  pre/post  skill  training  tests  (see  Appendix  B).  Each 
of  these  tests  consisted  of  14  multiple-choice  items,  with  two  items  covering 
the  concepts  of  each  module  and  with  the  order  scrambled  between  the  pre¬ 
test  and  the  posttest.  These  tests  were  scored  as  a  total  score  and  as 
seven  subscales — one  for  each  of  the  seven  modules.  The  pretest  was  admin¬ 
istered  to  experimental  students  prior  to  their  beginning  the  skill  training 
package,  and  to  the  control  group  students  before  beginning  the  first  block 
of  the  course.  (The  experimental  students  went  into  the  first  block  of  the 
course  following  their  5-day  skill  training  period.)  The  posttest  was 
administered  to  both  experimental  and  control  students  at  the  beginning  of 
the  second  block  of  the  course.  As  such,  the  posttest  served  as  a  measure 
of  the  experimental  students'  retention  of  knowledge  taught  in  the  skill 
training  package,  and  served  as  a  measure  of  difference  in  knowledge  between 
experimental  and  control  students.  In  addition  to  these  knowledge  measures, 
data  of  an  anecdotal  nature  were  collected  in  the  form  of  instructor  comments 
and  written  student  critiques. 

Following  the  skill  training  sessions,  the  effectiveness  of  the  train¬ 
ing  package  was  assessed  by  a  number  of  student  PME  course  performance 
measures.  These  were  blocks  I  and  II  test  scores  and  failure  rates.  Fail¬ 
ure  rate  is  defined  as  the  number  of  times  students  fail  each  block  test. 
(Note:  Block  times  were  not  included  as  a  performance  measure.) 


Training  Procedures 

The  format  for  this  training  program  was  CMI :  Instructor-trainees 
and  students  read  the  materials  at  their  own  pace  and  took  tests  over  these 
materials  when  they  were  ready  to  be  evaluated.  The  CMI  system  graded  each 
of  their  tests  and  gave  them  their  next  assignment.  Periodic  group  dis¬ 
cussions  were  held  to  give  instructor-trainees  and  students  the  opportunity 
to  practice  new  skills,  share  strategies  and  techniques  for  implementing 
these  skills,  discuss  problems  and  solutions,  and  share  similar  frustrations 
and  successes. 

The  contract  investigators  served  as  the  group  leaders  for  the  in¬ 
structor  training  course,  and  these  instructors  then  served  as  group  leaders 
for  the  student  skill  training.  The  role  of  the  group  leader  v/as  defined 
as  one  of  facilitator  and  counselor,  and  thus  techniques  for  active  listening 
and  clarifying  were  stressed.  When  reviewing  the  exercises  described  in  the 
materials  during  the  group  sessions,  the  group  leaders  encouraged  subjects 
to  learn  from  one  another.  There  were  no  right  or  wrong  answers,  so  it  was 
important  for  the  subjects  to  learn  alternative  solutions,  approaches,  or 
techniques. 

The  modules  in  the  CMI  Instructor  Role  Training  Program  are:  Module  1: 


The  Role  of  the  Instructor  in  CHI;  Module  2:  Preparing  to  be  a  CMI  Instructor 
Module  3:  Understanding  the  Technical  Training  Student;  Module  4:  The  In¬ 
structor  as  a  Learning  Manager — Planning  the  Environment;  Module  5:  The 


Instructor  as  a  Learning  llanager — Planning  Instructional  Events;  Module  6: 

The  Instructor  as  an  Implementor  of  CMI  Plans;  f'odule  7:  The  Instructor 
as  an  Evaluator;  ftodule  3;  The  Instructor  as  a  Hlagnostlclan;  Module  9: 

The  Instructor  as  a  Remedlator;  Module  10:  The  Instructor  as  a  Counselor 
and  Career  Advisor;  Module  11:  The  Instructor  as  a  Modeler;  and  fbdule  12: 
Coordinating  CMI  Instructor  Roles — Putting  It  All  Together.  The  group 
discussions  covering  these  modules  focused  on  the  major  concepts,  principles, 
and  strategies  presented  In  each  module  and  gave  subjects  an  opportunity  to 
share  their  experiences  In  these  areas. 

After  the  contract  Investigators  trained  the  technical  training  In¬ 
structors,  the  Instructors  were  encouraged  to  follow  a  similar  training  format 
for  the  Student  flotivatlonal  Skill  Training  Package,  taking  up  to  5  days 
for  this  training  and  Incorporating  their  own  Ideas  and  procedures  in  group 
discussions  as  they  saw  fit.  One  of  the  Instructors  volunteered  to  be  the 
first  Senior  Instructor  for  the  student  training.  A  Junior  Instructor  was 
then  chosen  from  among  the  trained  Instructors  by  the  second  shift  supervisor. 
These  two  Instructors  then  conducted  the  first  class  of  student  training. 

For  the  second  week  of  student  tralr’ng,  the  Junior  Instructor  from  the  first 
week  became  the  Senior  Instructor  and  another  trained  Instructor  was  chosen 
'to  be  the  Junior  Instructor  this  v/eek.  This  procedure  continued  each  week 
with  a  new  Junior  Instructor  being  chosen  by  the  supervisor  and  the  old 
Junior  Instructor  becoming  the  Senior  Instructor.  Cotitract  Investigators 
met  with  Senior  and  Junior  Instructors  each  week  of  the  student  trc, •  .rg 
period  to  answer  questions  and  discuss  the  effectiveness  of  various  Inr  ^tlons 
Implemented  by  the  Instructors. 


Data  Collection  and  Analysis  Procedures 


A11  of  the  performance  measures  were  administered  and  the  data  collectr^ 
by  the  AIS.  The  AIS  also  provided  data  analysis  capabilities,  including  the 
use  of  the  Statistical  Program  for  Social  Sciences  (SPSS)  in  evaluation  analyses 


RESULTS 


Results  of  the  evaluation  analyses  are  presented  in  three  categories 
pertaining  to  students'  (1)  knowledge  of  concepts  presented  in  the  skill 
modules;  (2)  attitudes  and  opinions  about  the  training  package;  and  (3) 
course  performance  following  the  skill  training.  Analysis  procedures  and 
findings  in  these  areas  are  presented  in  the  following  sections.  In  addi¬ 
tion,  anecdotal  information  obtained  from  discussions  with  instructors  and 
supervisory  personnel,  and  from  limited  observations  of  students  in  the 
learning  centers,  is  reported. 

Student  Knowledge  of  Concepts  in  Skill  Modules 

The  degree  to  which  students  learned  the  concepts  presented  in  the 
Student  Motivational  Skill  Training  Package  was  assessed  by  end-of-modul e 
knowledge  tests  and  pre/post  skill  training  knowledge  tests.  The  results 
for  these  two  sets  of  measures  are  presented  in  the  following  sections. 


End-of-Modul e  Knov/ledqe  Tests.  The  module  tests  taken  by  students  at 


the  end  of  each  of  the  seven  modules  contained  five  cognitive  items  and 
three  attitude  items.  Students  took  this  test  only  once  and  were  required 
to  achieve  a  criterion  of  4  out  of  5  (80  percent)  on  the  cognitive  items. 

For  students  who  did  not  reach  this  criterion,  instructions  were  given 
that  they  review  items  missed  with  their  training  leader  before  going  on  to 
the  next  module. 

Test  item  analysis  results  maintained  and  reported  by  the  AIS  were 
available  for  all  82  students  who  completed  the  package.  The  average  cog¬ 
nitive  test  scores  per  module  and  percentage  of  students  passing  each  module 
on  the  first  attempt  are  reported  in  Table  1.  The  majority  of  students 
answered  the  cognitive  items  correctly  and  passed  each  module's  criterion 
test  on  the  first  atc^mpt. 

Pre/Post  Skill  Training  Knowledge  Tests.  Pre/post  skill  training  tests 
were  administered  to  PME  students  in  the  experimental  and  control  groups  as 
described  in  the  Measures  sectior.  on  pages  25  and  26.  An  error  in  the 
variable  definition  procedures  invalid-sted  data  collected  on  the  Career 
Exploration  module  suoscale  for  both  the  pretest  and  posttest  measures.  The 
means  for  all  other  module  subscales  and  the  total  scores  on  each  test  for 
both  groups  are  reported  in  Table  2.  Results  indicated  that  (1)  students  in 
the  experimental  and  control  groups  did  not  differ  significantly  on  any  of 
the  module  subscales  or  total  scale  for  the  pretest  measure;  (2)  students  in 
the  experiitental  group  obtained  significantly  higher  scores  on  the  total 


TABLE  1 


End-Of-flodul e  Knowledge  Test 
Performance  for  Experimental  Group  {n=82) 


Varlabl  e 

Test 

y 

Scores* 

SD 

Percent  Reaching 
Criterion  on 

First  Attempt 

Module  1 

4.29 

1.26 

85. 8X 

Module  2 

4.13 

1.64 

82.  OX 

Module  3 

4.33 

1.08 

86.  OX 

Module  4 

4.29 

.94 

85. 8X 

Module  5 

4.28 

1.18 

85.4% 

Module  6 

4.29 

.99 

85. 8X 

Module  7 

4.04 

.92 

80. 4X 

♦Results  for  the  sum  of  five  cognitive  Items,  where  maximum  possible 


score  Is  5 


posttest  [t(l ,32)=-2.53,  p.  ^  .02J,  on  the  Introduction  module  subscale 
[t(l ,32)=-2.25,  p.  L  .04];  and  on  the  Effective  Communication  module 
subscale  [t{l ,32)=-2.18,  p  Z  .04];  and  (3)  differences  between  experimental 
and  control  group  students  approached  significance  on  the  Goal  Setting 
module  subscale  [t(l ,32)=-l .68,  p  L  .11]  and  on  the  Problem  Solving  module 
subscale  [t(l ,32)=-l .93,  p  Z  .07]. 

Thus,  experimental  students  had  higher  knowledge  scores  than  control 
group  students  on  all  but  two  of  the  modules  available  for  analysis — the 
Values  Clarification  module  and  the  Stress  Management  module.  Experimental 
students  did  achieve  somewhat  higher  mean  scores  than  did  control  group 
students  on  these  two  modules,  although  these  differences  did  not  approach 
significance. 

Student  Attitudes  and  Opinions  About  Skill  Training  Package 

How  students  In  the  experimental  group  felt  about  the  Student  Motiva¬ 
tional  Skill  Training  Package  was  assessed  by  (a)  end-of-modul e  attitude 
test  scores  and  (b)  written  student  critiques  completed  at  the  end  of  the 
skill  training  period.  Results  In  both  areas  are  reported  below. 


End-of-Hodule  Attitude  Tests,  The  three  attitude  Items  on  the  end-of- 
modul  e  tests  for  the  seven  student  modules  asked  students  (1)  If  they  liked 
the  module,  (2)  If  they  felt  the  Information  was  useful  to  them,  and  (3)  to 
Indicate  the  level  of  effort  they  would  exert  for  the  module.  These  data 
are  summarized  In  Table  3,  In  terms  of  the  percentage  of  students  choosing 
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Pre/Post  Skin  Training  Knowledge  Test  Results 


each  response  category  for  each  item  per  module.  (NOTE:  For  the  first  two 
items,  responses  in  the  two  categories  on  either  side  of  moderate  were  grouped 
into  high  or  low.)  In  general.  Table  3  indicates  that  the  majority  of  PME 
students  participating  in  the  skill  training  liked  the  modules,  found  them 
useful,  and  were  willing  to  exert  at  least  moderate  levels  of  effort  to  learn 
and  apply  the  concepts  and  skills  presented.  The  following  general  rank 
order  of  modules  indicates  how  well  liked  and  useful  students  felt  they 
were:  (1)  Introduction  module,  (2)  Effective  Communication  module,  (3) 

Stress  Management  module,  (4)  Goal  Setting  module,  (5)  Problem  Solving 
module,  (6)  Values  Clarification  module,  and  (7)  Career  Exploration  module. 

Student  Critiques.  A  total  of  66  of  the  82  students  who  participated 
completed  written  critiques  of  their  experience  with  the  package.  These 
were  open-ended  forms  wherein  students  stated  their  opinions  about  the 
package  in  a  short  essay.  Opinions  and  comments  from  these  critiques  were 
categorized  into  five  areas  (Quality  of  the  Materials,  Opinion  of  the  Class¬ 
room  Training  Procedures  and  Experiences,  Effect  of  the  Training  Package, 
Quality  of  Instructors  Facilitating  Skill  Training,  Suggested  Changes  in 
Student  Skills  Package)  and  a  variety  of  specific  opinions  or  comments  per 
category  were  listed.  Table  4  summarizes  these  data  and  shows  the  number  of 
students  who  expressed  each  listed  opinion  or  comment  about  the  skill  training. 
These  results  generally  indicate  that  students  (a)  found  the  modules  well- 
written  and  easy  to  read  and  understand,  but  some  felt  the  materials  were 
too  simple  and  basic  or  repetitive  and  boring;  (b)  felt  the  classroom  training 
procedures  were  good  and  provided  an  enlightening,  enriching,  informative. 
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TABLE  3 


j: 

PME  Student  End-of- 

•Module  Attitudes  Toward 

Each  Module  (n=82) 

STUDENT 

RESPONSE 

CATEGORY 

SKILL 

NO 

MODULES 

HI 

MED 

LO 

RESPONSE 

. 

2 

Introduction  Module 

- 

Liked 

82% 

10% 

1% 

7% 

Useful 

81% 

10% 

2% 

6% 

* 

Level  of  Effort 

51% 

35% 

7% 

7% 

Values  Module 

Liked 

66% 

20% 

10% 

4% 

Useful 

71% 

16% 

9% 

4% 

• 

Level  of  Effort 

45% 

41% 

10% 

4% 

Career  Module 

# 

Liked 

64% 

27% 

6% 

3% 

Useful 

71% 

22% 

3% 

4% 

Level  of  Effort 

39% 

43% 

15% 

3% 

Goal  Setting  Module 

t 

Liked 

73% 

18% 

7% 

2% 

1  ' 

Useful 

73% 

21% 

5% 

1% 

• 

Level  of  Effort 

40% 

43% 

15% 

2% 

Stress  Module 

Liked 

81% 

15% 

0% 

4% 

s 

Useful 

82% 

13% 

0% 

5% 

Level  of  Effort 

43% 

46% 

6% 

5% 

Communication  Module 

Liked 

82% 

13% 

1% 

4% 

4 

Useful 

82% 

15% 

0% 

3% 

> 

Level  of  Effort 

48% 

45% 

5% 

2% 

Problem  Solving  Module 

Liked 

69% 

22% 

7% 

2% 

9 

Useful 

69% 

22% 

6% 

3% 

P 

Level  of  Effort 

32% 

50% 

15% 

3% 

I 
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interesting,  useful,  and  realistic  experience;  (c)  felt  the  training  package 
would  have  a  helpful  effect  in  their  personal  lives  and  would  prepare  them 
for  the  technical  training  environment,  as  well  as  help  them  look  at  them¬ 
selves  from  a  different  point  of  view;  (d)  rated  their  instructors  as 
good,  helpful,  and  well-informed;  (e)  felt  the  training  package  should  be 
mandatory  for  all  technical  training  students;  and  (f)  felt  a  shortened  or 
more  condensed  version  of  the  package  might  be  better,  particularly  for 
older  and  more  experienced  students. 

In  summary,  the  attitude  findings  generally  indicate  that  students 
liked  the  training  package  and  felt  the  training  concepts  and  experience 
would  be  helpful  in  both  their  personal  lives  and  in  their  technical  train¬ 
ing  experience. 

Student  Course  Performance 


The  impact  of  the  Student  flotivatlonal  Skill  Training  Package  on  students 
subsequent  performance  in  the  PME  courses  was  assessed  by  measures  of  students 
block  test  scores  and  number  of  attempts  on  the  block  test.  These  data  for 
Blocks  1  and  2  are  presented  in  Table  5  for  experimental  and  control  group 
students.  (The  number  of  cases  available  in  subsequent  blocks  of  the  PfIE 
course  was  too  small  for  reliable  analysis.) 

Block  Score  Results.  The  block  score  data  reported  in  Table  5  were 
analyzed  by  the  SPSS  t-test  program  to  determine  significant  differences 
between  experimental  and  control  groups.  The  analyses  Indicated  that 
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TABLE  4 

PME  Student  Opinions  of  and  Comments  About 
the  Student  Motivational  Skill  Training  Package 


Comments  Within 

Opinion  Category  Frequency* 


Quality  of  the  materials 

1. 

Modules  are  easy  to  read  and  understand;  well 
written 

11 

2. 

Too  simple;  basic 

6 

3. 

Some  materials  were  repetitive;  boring 

4 

4. 

Comprehensive 

1 

r 

5. 

Need  more  examples 

1 

6. 

7. 

Some  Information  was  contradictory 

Some  exercises  were  too  difficult;  they 

1 

"dug  too  deep"  1 


Opinion  of  Classroom  Training  Procedures  and  Experiences 


1. 

Interesting  class*  enlightening,  enriching. 

Informative 

22 

2. 

Good  class 

13 

3. 

Useful  and  realistic  class 

4 

4. 

If  taken  seriously.  It  would  be  a  better  class 

4 

5. 

Some  of  the  Information  I  have  already  learned 

3 

6. 

Moderately  useful 

3 

7. 

Liked  the  group  discussions 

1 

8. 

Name  of  course  should  be  "Get  To  Know  You" 

1 

9. 

Well  organized  class 

1 

10. 

Waste  of  time 

1 

Effect  of  Training  Package 

1. 

Helpful  In  my  personal  life 

12 

2. 

Helps  students  prepare  for  the  technical  training 

environment 

12 

3. 

Helped  me  look  at  self  from  a  different  point  of 
view,  understand  myself  and  straighten  out  some 

confusions 

9 

4. 

Gave  me  new  Ideas 

3 

5. 

Helps  me  learn  how  to  Improve  myself 

1 

6. 

Helped  me  learn  how  to  motivate  myself 

1 

7. 

Helped  me  to  adjust  to  life  away  from  home 

1 

8. 

Helped  me  Improve  my  attitudes 

1 

9. 

Caused  stress  by  too  many  self-evaluations 

1 
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TABLE  4  (Continued) 


Comments  Within 

Opinion  Category 

Frequency* 

Quality  of  Instructors  Facilitating  Skill  Training 


1. 

Good 

27 

2. 

Helpful 

8 

3. 

Well  Informed 

4 

Suggested  Changes  In  Student  Skills  Package 

1. 

Should  be  mandatory  for  all  technical  training 
students 

16 

2. 

Should  be  condensed;  shortened 

4 

3. 

People  with  prior  service  don't  need  this  train¬ 
ing;  especially  NCOs 

3 

4. 

Belongs  In  the  high  schools 

3 

5. 

Expand;  more  In  depth;  allow  more  time  so  students 
can  complete  all  of  the  exercises 

3 

6. 

Add  some  audio-visuals 

2 

7. 

Class  should  be  debating  class  rather  than 
discussion  class 

1 

8. 

More  communication  between  students  and  Instructors 
would  be  better 

1 

9. 

More  group  discussions 

1 

10. 

Make  exercises  more  specific 

1 

11. 

Different  room  needed 

1 

12. 

Should  be  given  only  to  poor  students 

1 

*  Frequency,  as  It  Is  used  here,  refers  to  the  number  of  students  who 
gave  the  specific  comments  or  opinions  listed  above. 
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experimental  students  obtained  significantly  higher  block  test  scores  in  both 
Block  1  [t(l,78)=-2.05.  p  /..05J  and  Block  2  [t(l  ,46)=-2.1 2,  p  4.05]. 


Number  of  Block  Test  Attempts.  As  shown  in  Table  5,  experimental  group 
students  had  significantly  fewer  block  test  attempts  in  Block  1  than  did 
students  in  the  control  group  [t(l ,79)=2.29,  p. 4  .03].  Although  experi¬ 
mental  students  also  had  fewer  block  test  attempts  in  Block  2,  these  results 
did  not  approach  significance. 

The  lower  part  of  Table  5  shows  the  actual  number  of  failures  on  the 

Block  1  and  2  tests  for  experimental  and  control  group  students.  This  com¬ 

parison  shows  a  dramatically  lower  number  of  block  test  failures  for 
experimental  group  students  compared  to  control  group  students  (i  e,,  4.3% 
versus  18.6%).  The  course  performance  results,  then,  indicate  that  the 
Student  Motivational  Skill  Training  Package,  combined  with  the  instructor 
training  component,  had  an  effect  on  improving  block  test  scores  and  reducing 

the  number  of  block  test  failures  in  the  first  two  blocks  of  the  PME  course. 

Anecdotal  and  Observational  Resul ts 


Several  sources  of  anecdotal  and  observational  information  were  avail¬ 
able  in  the  evaluation  of  the  Student  Motivational  Skill  Training  Package. 
These  included:  instructor  comments  about  the  training  package,  supervisor 
and  management  personnel  comments  and  reactions  to  the  package,  and  infor¬ 
mation  obtained  from  observing  students  in  the  CMI  learning  centers.  Results 
are  described  in  the  following  sections. 


TABLE  5 


Air  Force  PME  Student  Course  Performance  Means 
for  Experimental  and  Control  Groups 


PME 

Variable 

Experimental 

y  so 

n 

X 

Control 

SD 

n 

Block  1  Score 

85.00 

9.06 

38 

79.46 

14.21 

41 

Block  2  Score 

88.60 

7.97 

30 

83.00 

10.25 

18 

Block  1  Attempts 

1.05 

.32 

40 

1.24 

.44 

41 

Block  2  Attempts 

1.00 

.00 

30 

1.06 

.24 

18 

Number  of 

Failures 
(across  Blocks 

1  and  2) 

1 

3/70 

(4.3%' 

11/59 

(18.6%) 

40 


Instructor  Comments.  Comments  on  the  training  package  were  obtained 


from  Instructors  In  scheduled  discussion  times  held  with  Instructors  responsi¬ 
ble  for  the  administration  of  the  Package.  The  purpose  of  these  discussions 
was  to  answer  any  questions  about  the  package,  to  assist  with  any  problems 
that  arose  in  the  training,  or  to  offer  suggestions  on  particular  approaches, 
etc.  During  the  evaluation  period,  a  total  of  seven  Instructor  discussion 
sessions  were  held. 

PfIE  instructors'  comments  during  these  sessions  were  categorized  into 
three  areas:  Opinions  about  the  Skill  Training  Class,  Perceptions  about 
the  Effects  of  the  Skill  Training,  and  Suggestions  for  Changes  In  the 
Skill  Training  Procedures.  In  the  first  area.  Instructors  reported  that 
they  had  no  difficulties  In  facilitating  students'  acquisition  of  the  concepts 
and  skills  presented  in  the  training  modules.  They  did  indicate,  however,  that 
they  sometimes  had  difficulty  encouraging  students  to  participate  in  the  group 
discussions  and  that  it  took  some  period  of  time  for  students  to  relax  enough 
to  share  experiences  in  the  group  sessions.  Instructors  also  indicated  that 
the  modules  that  seemed  to  be  best  received  by  the  students  were  the  Stress 
Management,  Effective  Communication,  and  Career  Exploration  modules. 

In  terms  of  Instructors'  perceptions  of  the  effects  of  the  motivational 
skill  training,  instructors  generally  reported  that  (1)  absenteeism  was  down 
for  experimental  group  students;  (2)  students  were  able  to  use  the  self-paced 
and  computer  managed  format  of  the  skill  training  as  a  way  to  prepare  for 
the  demands  of  this  format  in  their  technical  training  experience  and  that 


It  helped  them  build  confidence  for  taking  tests;  (3)  the  feeling  of  "group" 
that  developed  as  a  result  of  the  skill  training  experience  helped  students 
have  more  positive  relationships  with  their  peers  and  their  Instructors;  and 
(4)  students  were  told  that  they  were  In  a  special  group  and  this  made  them 
feel  and  act  special  In  their  technical  training  experience. 

Changes  to  the  skill  training  which  instructors  suggested  Included  (1) 
developing  hypothetical  situations  which  students  could  use  as  a  format  for 
practicing  problem  solving  skills  In  small  group  sessions;  (b)  using  visuals 
to  present  an  outline  of  the  major  concepts  In  each  module;  (c)  having  stu¬ 
dents  use  some  method  of  marking  concepts  that  were  particularly  Important 
or  relevant  for  them  (e.g.,  "dog-earing"  pages);  (d)  having  Instructors 
become  more  Involved  In  the  actual  teaching  of  the  skills  and  strategies  and 
In  planning  the  group  discussions;  and  (e)  having  more  frequent  group  dis¬ 
cussions. 

Supervisor  and  Management  Personnel  Comments  and  Reactions.  During  the 
course  of  the  evaluation,  comments  on  the  Package  were  made  by  PHE  supervisory 
personnel  responsible  for  the  second  shift  and  civilian  personnel  responsible 
for  curriculum  development.  These  conments  can  generally  be  summarized  as 
follows:  (1)  the  materials  format,  concepts,  and  range  of  topics  covered 
were  felt  to  be  highly  relevant  and  covered  needed  areas  for  technical  training 
students;  (2)  the  length  of  the  training  package.  Including  group  Jscusslons, 
was  felt  to  be  appropriate  and  feasible  for  Implementation;  and  (3)  tangible 
effects  of  the  training  In  terms  of  higher  student  motivation,  shorter  com¬ 
pletion  times,  higher  test  scores,  and  fewer  failures  had  been  observed  In 


2 


» 

comparisons  of  experimental  versus  control  group  students.  Supervisory  and 

management  personnel  felt  so  positively  about  the  package,  and  its  potential 

impact  on  student  performance  and  attrition,  that  they  asked  if  copies  of  ^ 

the  student  skill  modules  could  be  made  available  for  implementation  with 

all  PME  Students  in  the  near  future. 

I 

Student  Comments 

Student  comments  about  the  benefits  of  the  training  package  were  that 
it  (1)  presented  concepts  that  were  useful  to  their  coursework,  particularly 
in  the  Stress  Management,  Goal  Setting,  and  Problem  Solving  modules;  (2) 
helped  them  get  ready  for  studying  the  course  materials  and  for  taking  tests; 

f 

(3)  would  be  most  helpful  for  students  who  are  less  mature,  less  motivated, 
and  of  lower  ability;  (4)  should  be  implemented  as  part  of  Basic  Training 
for  all  students:  and  (5)  should  be  taught  by  highly  qualified  instructors 

p 

who  understand  the  concepts  and  strategies  in  the  package. 


In  summary,  these  anecdotal  and  observational  data  generally  indicated 
favorable  student  reactions  to  the  training  package  and  its  benefits  to  them 
in  technical  training  and  beyond,  positive  instructor  reactions  to  the 
training  package  and  its  effects  on  student  behavior,  and  enthusiastic  super¬ 
visory  and  management  reactions  to  the  package. 


* 
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DISCUSSION  AND  CONCLUSIONS 


Summary  of  Findings 

The  effectiveness  of  the  Student  Motivational  Skill  Training  Package 
was  evaluated  in  terms  of  its  impact  on  students'  (1)  knov/ledge  of  concepts 
presented  in  the  skill  modules;  (2)  attitudes  and  opinions  about  the  train¬ 
ing  package;  and  (3)  course  ’Performance  following  the  skill  training.  In¬ 
structor  and  course  management  reactions  to  the  package  also  provided  a 
source  of  evaluation  information. 

Findings  relevant  to  students'  knowledge  of  concepts  presented  in  the 
seven  skill  training  modules  indicated  that  students  participating  in  the 
training  satisfactorily  reached  criterion  on  all  end-of-modul e  tests.  Results 
on  the  pre/post  skill  training  knowledge  tests  generally  indicated  that 
although  the  groups  did  not  differ  in  pretest  scores,  experimental  group 
students  compared  to  control  group  students  had  higher  scores  on  both  the  total 
posttest  and  the  majority  of  module  si  ^scales.  On  both  sets  of  knowledge 
measures,  then,  experimental  group  students  demonstrated  that  they  success¬ 
fully  acquired  the  concepts  presented  in  the  package. 

In  the  area  of  students'  attitudes  and  opinions  about  the  training 
package,  students'  initial  attitudes  at  the  end  of  the  training  experience 
and  their  subsequent  attitudes  after  they  were  in  their  technical  training 
course  were  highly  positive.  Students  indicated  that  they  felt  the  training 
concepts  and  experience  (a)  would  be  helpful  in  both  their  personal  lives 


and  in  their  technical  training  experience,  and  (b)  should  be  offered  to  all 
technical  training  students.  Once  experimental  group  students  were  in  their 
technical  training  course,  they  continued  to  react  positively  to  the  motiva¬ 
tional  skill  training  and  expressed  opinions  that  the  modules  gave  them 
concepts  that  were  useful  in  their  coursework  and  that  helped  them  get  ready 
for  studying  the  course  materials  and  for  taking  tests. 

The  findings  in  the  area  of  student  course  performance  focused  on  test 
performance,  using  measures  of  block  test  scores  and  number  of  block  test 
failures  for  experimental  versus  control  group  students.  Results  indicated 
that  experimental  group  students  had  significantly  higher  block  test  scores 
and  significantly  lower  block  test  failure  rates  than  did  control  group  stu¬ 
dents.  hese  findings  suggest  that  the  Package  may  impact  variables  related 
to  student  attrition  from  technical  training  (i.e.,  number  of  block  test 
failures)--a  suggestion  that  remains  to  be  verified  by  subsequent  research. 

Another  source  of  information  on  the  effectiveness,  relevance,  and 
utility  of  the  package  comes  from  the  comments  and  actions  of  instructors 
and  supervisory  and  management  personnel.  Instructors  reported  that  stu¬ 
dents  who  had  completed  the  skills  training  package  (1)  experienced  less 
absentee! Sim;  (2)  appeared  to  have  more  confidence  about  taking  tests;  and 
(3)  were  more  actively  involved  in  learning  and  were  not  afraid  to  ask 
questions. 

Reactions  of  supervisory  and  management  personnel  were  also  positive. 

They  felt  that  the  materials,  format,  concepts,  and  range  of  topics  covered 


45 


1n  the  package  were  highly  relevant  and  covered  needed  areas  for  technical 
training  students.  They  also  reported  that  they  had  observed  noticeable 
effects  of  the  package  on  the  development  of  positive  student  motivation, 
shorter  lessor  completion  times,  higher  test  scores,  and  fewer  failures  for 
experimental  versus  control  group  students.  Supervisory  and  management 
personnel  in  the  PME  course  have  asked  that  the  package  be  made  available 
in  the  near  future  to  all  students  in  the  course.  A  study  to  investigate 
alternative  presentation  formats  for  the  implementation  of  this  skill 
training  package  in  the  PME  course  has  been  suggested  for  the  near  future. 

Such  a  study  should  provide  insights  into  the  type  of  format  that  is  most 
effective  in  terms  of  Loth  student  performance  gains  and  instructor  partici¬ 
pation  requirements. 

It  seems  clear  from  this  summary  of  quantitative  and  qualitative  findings 
in  the  evaluation  of  the  Student  Motivational  Skill  Training  Package  that 
the  package  was  positively  received  and  that  improvements  occurred  in  the  per¬ 
formance  of  Air  Force  technical  training  students  in  the  PME  course.  The  find 
ings  also  suggest  there  may  be  some  feasibility  to  the  idea  of  modifying 
individuals'  pre-course  skills  and  strategies  such  that  motivation  is  en¬ 
hanced.  Some  limitations  anJ  some  additional  implications  of  these  findings 
are  presented  in  the  following  sections. 

Limitations  to  Findings 

Conclusions  drawn  from  this  evaluation  of  the  Student  Motivational  Skill 


Training  Package  must  consider  several  possible  limitations  to  the  study. 


(a)  Equality  of  the  two  student  groups  (control  and  experimental)  in 
regard  to  their  aptitude  for  the  PME  course  is  in  doubt,  leaving  some  ques¬ 
tion  as  to  the  cause(s)  of  differences  in  failure  rates  and  block  test  scores 
in  that  course. 

(b)  Special  non-conventional  instruction  skills  training  given  to 
experimental  group  instructors  at  the  beginning  of  this  study  may  partially 
account  for  the  superior  PME  course  performance  of  the  experimental  group. 

(c)  Some  of  the  experimental  group  improvements  in  attitude,  confidence, 
motivation,  and  rapport  with  instructors  and  other  students  might  be  results 
of  that  group's  pre-course  time  together.  These  students  participated  in 
the  4  to  5  days  of  motivational  skill  training,  which  contained  small-group 
discussions,  prior  to  start  of  the  PME  course.  During  that  time  they  experi¬ 
enced  peer  group  support  and  interactions  with  the  same  instructors  who  later 
taught  them  in  the  PME  course. 

(d)  The  Hawthorne  effect  may  account  for  some  motivation-related  changes. 
According  to  instructor  comments,  the  experimental  group  students  v/ere  told 
that  they  were  in  a  special  group,  and  this  made  them  feel  and  act  special 

in  their  technical  training  experience. 

(e)  The  tv/o  sets  of  knowledge  measures  (module  tests  and  pre/postest) 
used  to  demonstrate  that  experimental  group  students  acquired  the  motivational 
concepts  have  not  been  validated. 

Suggested  Areas  of  Future  Research 

Based  on  the  findings  of  this  study  and  the  implications  described  in 
the  preceding  section,  the  following  areas  of  future  research  are  suggested; 


47 


(1)  A  comparison  of  the  effectiveness  of  the  Student  f'otivational  Skill 
Training  Package  using  different  modes  of  application  (e.g.,  group 
lecture  vs.  group  lecture  and  discussion  vs.  self-paced  with  and 
without  trained  instructors).  This  study  would  help  to  clarify 
how  much  each  of  the  following  variables  contributes  to  the  effect 
of  the  training  package  on  student  attitudes  and  performance:  the 
training  materials  alone;  group  discussions  of  the  topics  presented 
in  the  training  materials;  and  trained  instructors.  Understanding 
the  contribution  to  the  overall  effect  of  the  training  package  is 
important  because,  for  example,  if  the  materials  were  found  to  be 
equal,  or  nearly  equal,  in  effectiveness  when  implemented  with  and 
without  trained  instructors,  then  it  may  be  more  cost  effective  tc 
delete  the  instructor  training  used  in  the  PME  effort  described 
herein  and  let  students  learn  the  skills  completely  on  their  own. 

In  addition,  if  presence  of  instructors  does  not  add  to  the  effect¬ 
iveness  of  the  training  package,  it  may  have  value  in  an  exportable, 
packaged  format. 

(2)  An  investigation  of  the  use  of  computer-assisted  instruction  (CAI) 
for  some  or  all  port^’onr  of  the  Student  ftotivational  Skill  Training 
Package  should  be  uidertaken.  If  the  study  described  above  were 
completed  and  were  to  indicate  that  portions  of  the  training 
package  required  some  type  of  group  or  one-to-one  interaction, 
another  study  might  then  investigate  the  extent  to  which  CAI  could 
be  used  to  fulfill  these  requirements. 


(3)  An  Investigation  of  the  use  of  peer  counseling  for  some  portions 
of  the  Student  flotivational  Skill  Training  Package.  This  study 
would  complement  information  learned  in  the  preceding  study  and 
provide  information  on  a  potentially  effective  alternative  to  CAI. 
For  example,  if  it  were  discovered  that  the  training  package  re¬ 
quired  some  type  of  group  or  one-on-one  interaction,  the  extent 

to  which  students  could  be  trained  as  peer  counselors  to  fulfill 
the  interaction  requirements  v/ould  be  investigated. 

(4)  A  study  which  investigates  the  degree  to  which  the  current  version 
of  the  package  could  effectively  be  individualized.  This  effort 
would  involve:  (1)  determining  the  extent  to  which  individual  mod¬ 
ules  or  subsets  of  modules  within  the  training  package  result  in 
significant  improvements  in  student  course  performance;  (2)  fur¬ 
ther  evaluating  whether  the  individual  modules  or  subsets  of 
modules  result  in  the  students'  acquisition  of  the  concepts  and 
skills  taught  and  whether  the  existing  skill  measures  are  pre¬ 
dictive  of  student  performance  in  technical  training;  (3)  identi¬ 
fying  individual  difference  factors,  from  the  validated  battery 

of  individual  difference  measures  included  in  this  training  package, 
that  are  differentially  predictive  of  the  types  of  students  most 
likely  to  benefit  from  an  individual  module  or  subsets  of  modules 
and  refining  this  battery;  (4)  determining  the  class  of  adaptive 
decision  models  and  set  of  decision  rules  most  appropriate  for  use 
in  the  assignment  and  reassignment  of  students  to  selected  training 
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modules;  and  (5)  implementing,  and  evaluating  the  effectiveness  of, 
the  adaptive  decision  model  for  enhancing  student  course  performance 
and/or  acquisition  of  new  skills  and  behaviors, 

(5)  An  expansion  and  enhancement  of  the  existing  Student  Motivational 
Skill  Training  Package.  These  expansions  and  enhancements  could 
include  adding  a  module  that  details  the  role  of  positive  self- 
control  in  self-*  esof-rt,  self-esteem,  motivation,  and  achievement. 
Additionally,  on  the  basis  of  the  results  of  the  investigation 
described  in  this  report,  some  revisions  or  expansions  of  the 
existing  modules,  the  practice  exercises,  the  group  discussions, 
and  the  instructor  training  would  be  appropriate  and  desirable, 

(6)  An  investigation  of  other  student  target  groups  in  both  military 

and  civilian  Lraining  settings.  This  effort  would  involve  identifying 
other  student  groups  who  could  potentially  benefit  from  this  type 
of  motivational  skill  training,  defining  the  characteristics  of 
these  groups,  and  tailoring  une  existing  package  to  the  needs  of 
these  groups.  For  example,  the  package  could  be  tailored  to  tech¬ 
nical  training  stude.its  of  varying  ability  levels,  as  well  as  to 
military  enlistees  of  various  ranks,  ages  or  specialities. 

The  researchers  on  this  project  have  developed  a  set  of 
recommendations  for  implementing  the  products  of  this  effort. 

These  recommendations  are  provided  in  Appendix  C.  Any  further 
re'^earch  on  the  package  should  follow  these  recommendations 


carefully  in  order  to  insure  that  organizational  change  is  accommo¬ 
dated  in  an  effective  and  productive  fashion  and  has  minimal  impact 
on  the  research  results. 
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APPENDIX  A 


End-of-Module  Tests  for 
Student  Motivational  Skill  Training  Package 


Module  1 


Introduction  Posttest 

1.  What  is  the  most  basic  step  of  Kaslow's  hierarchy  of  needs? 

a.  Physical 

b.  Security 

c.  Social 

2.  If  you  tell  yourself  that  you  are  capable  and  motivated  to  complete  tech¬ 
nical  training,  imagine  yourself  achieving  this  goal,  and  then  actually  do 
successfully  complete  technical  training,  this  is  an  example  of 

a.  positive  self-tal!.. 

b.  self-fulfilling  prophecy, 

c.  being  your  own  coach. 

3.  If  you  are  being  your  own  coach,  you  will  want  to 

a.  motivate,  calm,  and  direct  yourself. 

b.  correct,  punish,,  and  stimulate  yourself, 

c.  direct,  correct,  and  evaluate  yourself. 

4.  Using  imagination  is  important  because 

a.  it  gives  you  a  chance  to  get  away  from  the  situation  and  think  about 
something  else. 

b.  it  gives  you  a  chance  to  rehearse  what  you  are  going  to  say  and  do 
and  practice  success. 

c.  it  gives  you  a  chance  to  correct  your  mistakes  and  be  positive  about 
the  situation. 

5.  You  are  reading  some  technical  training  material  and  are  having  a  lot  of 
trouble  understanding  it.  What  wo 'Id  be  a  positive  self-talk  statement 
that  you  could  make  to  yourself? 

a.  I'm  smart  enough  to  learn  this  if  the  people  who  had  written  it  had 
done  a  better  Job. 

b.  I'm  smart  enough  to  Irarn  this  and  1  am  going  to  learn  this.  I  can 
do  it. 

c.  I'm  not  as  smart  as  I  thought  I  was  so  maybe  I  should  give  up  on  learning 
this  information. 

d.  I'm  smart  enough  to  learn  this  but  it's  so  boring  that  I  really  don't 
want  to  try. 

6.  How  did  you  like  this  module? 

a.  very  much 

b.  quite  a  bit 

c.  moderately 

d.  somewhat 

e.  not  at  all 
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htodule  1  (continued) 


7.  How  useful  do  you  feel  the  Information  you  learned  is  to  you? 

a.  very  useful 

b.  quite  useful 

c.  moderately  useful 

d.  somewhat  useful 

e.  not  at  all  useful 

8.  What  level  of  effort  did  you  choose  for  the  majority  of  this  module? 

a.  Level  1 

b.  Level  2 

c.  Level  3 
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Module  2 


f 


Values  Clarification  Posttest 

1.  What  Is  a  value? 

a,  A  personal  belief,  attitude,  opinion  or  behavior 

b,  A  preference — something  you  think  Is  Important 

c,  A  desire — something  you  really  want  to  do 

2.  How  do  people  get  their  values? 

a.  They  are  born  with  then 

b.  They  learn  them  frcm  other  people 

c.  They  automatical  1:,  pick  them  up 

d.  They  are  given  to  them  by  their  parents 

3.  After  reading  the  Values  Clarification  module,  did  you  select  an  area  to 
change  or  Improve? 

a.  Yes 

b.  No 

4.  If  you  selected  an  area  to  Improve  or  change,  did  you  fill  out  a  self-contract? 

a.  Yes 

b.  No 

5.  Is  creating  mental  pictures — using  your  Imagination— 

a.  easy  for  you  to  do? 

b.  difficult  for  you  to  do? 

c.  sometimes  easy  and  sometimes  difficult? 

6.  How  did  you  like  this  module? 

a.  very  much 

b.  quite  a  bit 

c.  moderately 

d.  somewhat 

e.  not  at  all 

7.  How  useful  do  you  feel  the  Information  you  learned  Is  to  jrou? 

a.  very  useful 

b.  quite  useful 

c.  moderately  useful 

d.  somewhat  useful 

e.  not  at  all  useful 

8.  What  level  of  effort  did  you  choose  for  the  majority  of  this  module? 

a.  Level  1 

b.  Level  2 

c.  Level  3 
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Module  3 


# 


T 

H 
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Career  Exploration  Posttest 

1.  What  is  the  difference  between  a  decision  and  an  outcome? 

a.  A  decision  is  the  act  of  selecting  among  two  or  more  options  and  an  out¬ 
come  Is  the  result  of  a  decision. 

b.  A  good  decision  always  leads  to  a  good  outcome  and  a  poor  decision  always 
leads  to  a  poor  outcome. 

c.  A  decision  cannot  be  controlled  by  a  person  but  an  outcome  can  be  con¬ 
trolled. 

2.  What  is  a  good  decision? 

a.  One  which  uses  the  skills  of  decision-making  to  select  the  option  that 
Is  most  likely  to  produce  the  outcome  wanted  by  the  person  making  the 
decision. 

b.  A  decision  which  Is  based  on  all  of  the  facts  of  the  situation  and 
which  guarantees  the  outcome  wanted  by  the  person  making  the  decision. 

c.  A  decision  which  produces  the  outcome  wanted  by  the  person  making  the 
decision — regardless  of  how  It  was  made. 

3.  If  a  person  finds  out  after  reading  the  Career  Exploration  Module  that  he 
or  she  wants  to  pursue  a  career  that  Is  completely  different  from  the 
military  career  field  to  which  he  or  she  Is  assigned,  what  Is  the  best 
strategy  for  that  person? 

a.  Look  into  cross-training  procedures  and  then  attend  the  training  for 
this  second  career  field  as  soon  as  possible. 

b.  Develop  a  plan  for  getting  the  most  out  of  their  current  training  and 
use  this  experience  as  a  stepping  stone  for  achieving  a  career  which 
does  match  their  skills,  values,  needs,  and  ambitions. 

c.  Develop  a  plan  for  either  flunking  out  or  getting  a  motivational  drop 
from  their  current  military  technical  training  course  and  trying  to 
get  Into  a  more  appropriate  career  field. 

4.  The  code  which  Joe  Student  identified  for  himself  through  the  Self-Directed 
Search  Is  CES.  The  occupations  listed  under  this  code  Include  accountant 
and  credit  manager.  What  can  Joe  Student  say  about  his  code? 

a.  That  he  would  be  a  good  accountant  or  credit  manager  and  has  the  skills 
and  abilities  to  do  these  jobs  well. 

b.  That  he  should  not  consider  going  Into  any  occupations  other  than  those 
listed  under  the  CES  code  because  he  will  not  enjoy  them. 

c.  That  his  Interests  and  the  Interests  of  accountants  and  credit  managers, 
who  are  happy  with  their  jobs,  are  very  similar. 

d.  That  If  he  decides  to  become  an  accountant  or  a  credit  manager,  he  will 
definitely  be  happy  with  his  career. 
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Module  3  (continued) 


5.  Career  decisions  are 

a.  made  by  most  people  only  once  or  twice  In  a  lifetime. 

b.  a  life-long  series  of  choices. 

c.  generally  made  once  every  5  or  10  years. 

6.  How  did  you  like  this  module? 

a.  very  much 

b.  quite  a  bit 

c.  moderately 

d.  somewhat 

e.  not  at  all 

7.  How  useful  do  you  feel  the  Information  you  learned  Is  to  you? 

a.  very  useful 

b.  quite  useful 

c.  moderately  useful 

d.  somewhat  useful 

e.  not  at  all  useful 

8.  What  level  of  effort  did  you  choose  for  the  majority  of  this  module? 

a.  Level  1 

b.  Level  2 

c.  Level  3 
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Module  4 

Goal  Setting  Posttest 

1.  What  is  the  purpose  of  questioning? 

a.  It  helps  you  focus  your  attention  on  important  information. 

b.  It  helps  you  rehearse  what  you  are  going  to  say  and  do, 

c.  It  helps  you  build  and  maintain  a  positive  self-image. 

2.  What  is  the  purpose  of  brainstorming? 

a.  To  get  a  group  of  people  to  work  together  to  solve  a  problem. 

b.  To  evaluate  the  usefulness  of  different  alternatives. 

c.  To  generate  many  different  alternatives  to  a  problem  or  a  goal 

3.  What  is  the  purpose  of  using  Imagination  in  Goal  Setting? 


a. 


b. 


c. 


To  help  you  figure  out  the  most  effective  plan  for  achieving  your  dreams 
and  ambitions. 

To  help  you  set  up  a  positive  self-fulfilling  prophecy  and  to  allow  you 
to  rehearse  what  you  will  say  and  do. 

To  help  you  forget  about  all  the  problems  and  difficulties  which  may 
be  ahead  of  you. 


4.  What  is  a  good  way  to  keep  yourself  motivated  to  stick  with  your  plans? 

a.  To  reward  yourself  for  accomplishing  a  specific  number  of  tasks. 

b.  To  set  very  high  goals  that  you  will  have  to  work  extremely  hard  to  reach. 

c.  To  plan  for  how  you  are  going  to  handle  the  problems  that  come  up. 

5.  What  are  the  two  guidelines  for  writing  goal  statements? 


a. 

They  should  be  based  on  a  baseline  and  a  contract 

b. 

They  should  be  definite  and  have  deadlines. 

c. 

They  should  be  positive  and  definite. 

B 

6.  How 

did  you  like  this  module? 

a. 

very  much 

b. 

quite  a  bit 

c. 

moderately 

d. 

somewhat 

4 

e. 

not  at  all 

7.  How 

useful  do  you  feel  the  information  you  learned  is 

[ 

a. 

very  useful 

r 

b. 

quite  useful 

1- 

ir  ^ 

c. 

moderately  useful 

^  1 

d. 

somewhat  useful 

► 

• 

e. 

not  at  all  useful 

■ 

8.  What  level  of  effort  did  you  choose  for  the  majority 

■ 

a. 

Level  1 

1 

b. 

Level  2 

c. 

Level  3 
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Module  5 


* 


Stress  Management  Posttest 


1.  Which  of  the  following  is  most  likely  to  lead  to  feelings  of  stress? 

a.  changing  Jobs  and  Job  responsibilities 

b.  thinking  we  are  in  a  situation  we  can't  handle 

c.  having  a  tight  schedule  of  things  to  complete 

2.  Mistaken  beliefs  can  lead  to  feelings  of  stress  because 

a.  they  make  us  feel  helpless  and  afraid. 

b.  they  are  beliefs  no  one  else  has. 

c.  they  lead  to  negative  perceptions  of  a  situation. 

3.  Why  does  physical  exercise  help  reduce  feelings  of  stress? 

a.  It  slows  down  our  whole  system. 

b.  It  helps  build  confidence  in  our  abilities. 

c.  It  increases  our  energy  level. 

4.  Thinking  about  situations  in  positive  ways  helps  reduce  feelings  of  stress 
because 

a.  it  helps  us  be  in  control  of  our  feelings  and  physcial  reactions. 

b.  it  makes  us  believe  that  nothing  harmful  can  happen  to  us. 

c.  it  convinces  us  that  most  situations  are  not  stressful. 

5.  What  is  the  major  problem  with  using  alcohol,  drugs,  or  pills  to  cope  with 
stress? 

a.  They  keep  us  from  effectively  Interacting  with  people  who  could  help  us. 

b.  They  often  lead  to  new  problems  and  increased  feelings  of  stress. 

c.  They  are  ways  of  coping  that  are  not  socially  acceptable. 

6.  How  did  you  like  this  module? 

a.  very  much 

b.  quite  a  bit 

c.  moderately 

d.  somewhat 

e.  not  at  all 

7.  How  useful  do  you  feel  the  Information  you  learned  is  to  you? 

a.  very  useful 

b.  quite  useful 

c.  moderately  useful 

d.  somewhat  useful 

e.  not  at  all  useful 

8.  What  levjl  of  effort  did  you  choose  for  the  majority  of  this  module? 

a.  Level  1 

b.  Level  2 

c.  Level  3 
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Ftodule  6 


Effective  Communication  Posttest 

1.  Leslie  is  moving  from  the  dormitory  on  base  to  an  apartment  off  base.  She 
asked  Tim  to  help  her  move  on  Saturday  and  he  agreed.  When  Saturday  morn¬ 
ing  arrived,  Tim  told  Leslie  he  was  sorry,  but  he  had  made  some  other  plans 
and  couldn't  help.  Which  of  the  following  is  an  assertive  way  for  Leslie 
to  express  her  feelings? 

a.  "I  don't  understand  how  you  can  let  me  down  like  this.  You  knew  that 
I  was  really  counting  on  you  to  help  me  move." 

b.  "You  promised  to  give  me  a  hand  with  moving  today  and  now  you  are 
backing  out  of  that  promise.  You  can  be  sure  I  won't  ask  for  your 
help  again." 

c.  "You  agreed  to  help  me  move  today  and  yet  you  went  ahead  and  made  other 
plans.  That  puts  me  in  a  real  bind  and  I  feel  very  angry  with  you." 

2.  When  peopie  act  non-assertively  or  aggressively,  they  are  often  saying 

a.  "I  am  afraid  and  uncomfortable  in  this  situation." 

b.  "I  want  to  win  and  I  don't  care  about  your  feelings." 

c.  "I  like  the  way  I  am  and  you  can't  change  me." 

3.  The  biggest  problem  with  "you-messages"  is  that  they 

a.  put  the  other  person  on  the  defensive. 

b.  make  the  other  person  not  want  to  talk  to  you. 

c.  keep  the  other  person  from  hearing  what  you  said. 

4.  How  do  "I-messages"  help  you  gain  control  of  your  life? 

a.  They  help  keep  other  people  from  reacting  to  you  in  defensive  ways. 

b.  They  help  you  take  responsibility  for  your  feelings,  wants,  and  needs. 

c.  They  help  you  understand  other  people's  feelings  about  you. 

5.  Effective  listening  skills  can  minimize  communication  problems  because 

a.  They  give  the  other  person  a  chance  to  do  most  of  the  talking. 

b.  They  help  you  make  sure  you  understood  what  the  other  person  said. 

c.  They  keep  you  from  using  too  many  "you-messages"  with  others. 

6.  How  did  you  like  this  module? 

a.  very  much 

b.  quite  a  bit 

c.  moderately 

d.  somewhat 

e.  not  at  all 

7.  How  useful  do  you  feel  the  information  you  learned  is  to  you? 

a.  very  useful 

b.  quite  useful 

c.  moderately  useful 

d.  somewhat  useful 

e.  not  at  all  useful 
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Module  6  (continued) 


What  level  of  effort  did  you  choose  for  the  majority  of  this  module? 

a.  Level  1 

b.  Level  Z 

c.  Level  3 


r^j 

« 

Module  7 

r 

Problem  Solving  Posttest 

1. 

What  two  skills  have  most  good  problem  solvers  learned? 

1 " 

a.  To  think  systematically  and  to  find  the  best  solutions. 

b.  To  find  the  best  solutions  and  to  have  confidence  In  themselves. 

c.  To  think  systematically  and  to  have  confidence  In  themselves. 

2. 

Countering  your  problem  definition  Is  an  effective  technique  because 

* 

a.  It  helps  you  remember  to  reward  yourself  for  your  successes. 

b.  It  helps  you  set  up  a  positive  self-fulfilling  prophecy. 

c.  It  keeps  others  from  saying  things  to  discourage  you. 

3. 

When  are  positive  self-talk  and  Imagination  used  In  solving  problems? 

a.  At  the  beginning  of  the  process. 

b.  At  the  end  of  the  process. 

c.  Throughout  the  process. 

» ' 

4. 

The  process  of  stepping  away  from  the  problem  for  awhile  and  not  trying  to 
solve  It  Immediately  Is  called 

f 

a.  Incubation. 

b.  procrastination. 

c.  retreating. 

T 

5. 

Which  step  of  the  problem  solving  process  prepares  you  for  handling  the 
difficulties  or  set-backs  that  may  occur? 

» ■ 

a.  Step  1:  Identifying  and  Defining  Your  Problem 

b.  Step  2:  Generating  and  Evaluating  Alternative  Solutions 

c.  Step  3:  Making  an  Implementation  Plan 

d.  Step  4:  Implementing  Your  Solution 

e.  Step  5:  Evaluating  Your  Progress 

1  ’ 

f-* 

6. 

How  did  you  like  this  module? 

1 

a.  very  much 

b.  quite  a  bit 

c.  moderately 

d.  somewhat 

e.  not  at  all 

t 

7. 

How  useful  do  you  feel  the  Information  you  learned  Is  to  you? 

1 

1 

a.  very  useful 

b.  quite  useful 

c.  moderately  useful 

d.  somewhat  useful 

e.  not  at  all  useful 

i 

< 

f  < 

] 

i 

8. 

What  level  of  effort  did  you  choose  for  the  majority  of  this  module? 

< 

a.  Level  1 

b.  Level  2 

c.  Level  3 

1 

« 

1^ . 
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APPENDIX  B 

Pre/Post  Skin  Training  Tests  for 
Student  Motivational  Skill  Training  Package 
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Test  Number:  0101007 


STUDENT  SKILLS  PRETEST 

1.  What  is  the  main  reason  that  people  experience  stress? 

a.  They  put  themselves  in  a  lot  of  stressful  situations. 

b.  They  don't  do  enough  physical  activity  to  reduce  stress. 

c.  They  see  situations  as  somehow  threatening  to  them. 

2.  One  of  the  best  ways  to  reduce  feelings  of  stress  is  to 

a.  try  to  forget  about  or  avoid  the  stressful  situation. 

b.  think  about  the  stressful  situation  in  positive  ways. 

c.  accept  the  stressful  situation  as  a  normal  part  of  living. 

3.  Do  you  have  any  specific  goals  which  you  are  currently  trying  to  achieve? 

a.  I'm  not  currently  working  on  any  goals. 

b.  I  am  currently  working  on  one  or  two  goals. 

c.  I  am  currently  working  on  three  or  more  goals. 

4.  Goal  setting 

a.  gives  people  a  technique  or  strategy  for  making  their  dreams  and 
ambitions  come  true. 

b.  gives  people  a  lot  of  trouble  because  it  is  impossible  to  plan  that 
far  into  the  future. 

c.  gives  people  an  effective  method  for  dealing  with  their  personal  pro¬ 
blems  or  conflicts. 

5.  If  you  had  been  waiting  in  line  for  30  minutes  to  cash  your  check  at  the 
bank  and  the  person  in  front  of  you  let  four  of  his  friends  break  into 
the  line,  what  do  you  think  is  the  best  way  to  handle  the  situation? 

a.  Look  angry  but  don't  say  anything  because  there's  nothing  you  can 
really  do. 

h.  Angrily  and  loudly  tell  the  person  that  his  friends  have  to  go  to  the 
end  of  the  line  and  wait  like  everybody  else, 
c.  Tell  the  person  that  you  know  he'd  like  to  help  his  friends  out  but 
that  you  don't  think  it's  fair  to  let  people  butt  in  the  line. 

6.  What  is  one  of  the  best  ways  to  handle  a  conflict  situation  with  another 
person? 

a.  Start  by  telling  them  "You  make  me  angry  when  you..." 

b.  Start  by  telling  them  "I  feel  angry  when  you..." 

c.  Ask  them  for  an  explanatijn  for  their  behavior. 

7.  Being  a  good  problem  solver  i  ; 

a.  a  skill  some  people  can  dc  better  than  others  because  they  were  born 
with  it. 

b.  a  technique  that  comes  frcm  solving  a  lot  of  math  problems, 

c.  a  method  for  thinking  systematically  and  being  self-confident. 
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STUDENT  SKILLS  PRETEST  (continued) 


rv’ 


8.  At  this  moment,  I  think  my  problem  solving  skills  are 

a.  not  very  good. 

b.  about  average. 

c.  pretty  good. 

9.  Do  you  think  that  you  are  Occupationally  Literate — are  you  Informed  about 
available  job  options,  knowing  what  skills  you  have,  and  understanding  your 
work  values? 

a.  Yes 

b.  No 

c.  I  don't  know 

10.  Have  you  selected  a  career  goal? 

a.  Yes 

b.  No 

11 .  What  Is  a  value? 

a.  A  personal  belief,  attitude,  opinion,  or  behavior. 

b.  A  preference— something  you  think  Is  Important 

c.  A  desire-something  you  really  want  to  do. 

d.  A  motivation— something  you  want  to  achieve. 

12.  How  do  you  feel  about  your  value  systen? 

a.  I  haven't  really  thought  about  It. 

b.  I  have  areas  I  still  need  to  think  through. 

c.  I'm  not  sure  what  It  Is. 

d.  I  feel  comfortable  with  It. 

13.  Using  Imagination  to  solve  problems  and  achieve  your  goals 

a.  Is  not  a  good  Idea  because  It  allows  you  to  avoid  the  situation. 

b.  Is  a  good  strategy  because  It  gives  you  a  chance  to  rehearse  what 
you  are  going  to  say  aid  do  In  the  "real"  situation. 

c.  Is  a  good  strategy  because  It  gives  you  a  chance  to  forget  about  the 
situation  and  take  a  new  point  of  view. 

14.  Your  self-image  Is  basically  what  you  think  of  yourself.  Your  self-image 
Is  built  from 

a.  your  parents  and  your  subconscious. 

b.  your  experiences  and  your  parents. 

c.  your  Imagination  and  your  subconscious. 

d.  your  self-talk  and  your  Imagination. 
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Test  Number:  0203007 


STUDENT  SKILLS  POSTTEST 


I 

► 

t 

a 
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1.  Using  Imagination  to  solve  problems  and  achieve  your  goals 

a.  Is  not  a  good  Idea  because  It  allows  you  to  avoid  the  situation. 

b.  Is  a  good  strategy  because  It  gives  you  a  chance  to  rehearse  what 
you  are  going  to  say  and  do  In  the  “real"  situation. 

c.  Is  a  good  strategy  because  it  gives  you  a  chance  to  forget  about 
the  situation  and  take  a  new  point  of  view. 

d.  Is  not  a  good  Idea  because  It  Is  very  hard  fur  most  people  to  create 
realistic  pictures  In  their  minds. 

2.  What  Is  a  value? 

a.  A  personal  belief,  attitude,  opinion,  or  behavior. 

b.  A  preference— something  you  think  Is  Important. 

c.  A  desire— something  you  really  want  to  do. 

d.  A  motivation— something  you  want  to  achieve. 

3.  Do  you  think  that  you  are  Occupationally  Literate— are  you  Informed  about 
available  job  options,  knowing  what  skills  you  have,  and  understanding  your 
work  values? 

a.  Yes 

b.  No 

c.  I  don't  know 

4.  Being  a  good  problem  solver  Is 

a.  a  skill  some  people  can  do  better  than  others  because  they  were  born 
with  It. 

b.  a  technique  that  comes  from  solving  a  lot  of  math  problems. 

c.  a  method  for  thinking  systematically  and  being  self-confident. 

5.  If  you  had  been  waiting  In  line  for  30  minutes  to  cash  your  check  at  the 
bank  and  the  person  In  front  of  you  let  four  of  his  friends  break  Into  the 
line,  what  do  you  think  Is  the  best  way  to  handle  the  situation? 

a.  Look  angry  but  don't  say  anything  because  there's  nothing  you  can 
really  do. 

b.  Angrily  and  loudly  tell  the  person  that  his  friends  have  to  go  to  the 
end  of  the  line  and  wait  like  everybody  else. 

c.  Tell  the  person  that  you  know  he'd  like  to  help  his  friends  out  but 
that  you  don't  think  It's  fair  to  let  people  butt  In  the  line. 

6.  What  Is  the  main  reason  that  people  experience  stress? 

a.  They  put  themselves  In  a  lot  of  stressful  situations. 

b.  They  don't  do  enough  physical  activity  to  reduce  stress. 

c.  They  see  situations  as  somehow  threatening  to  them. 

7.  Do  you  have  any  specific  goals  which  you  are  currently  trying  to  achieve? 

a.  I'm  not  currently  working  on  any  goals. 

b.  I  am  currently  working  on  one  or  two  goals. 

c.  I  am  currently  working  on  three  or  more  goals. 
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STUDENT  SKILLS  POSTTEST  (continued) 
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8.  Your  self-image  Is  basically  what  you  think  of  yourself.  Your  self-image 
Is  built  from 

a.  your  parents  and  your  subconscious. 

b.  your  experience  and  your  parents. 

c.  your  Imagination  and  your  subconscious. 

d.  your  self- talk  and  your  Imagination. 

9.  At  this  moment,  I  think  my  problem  solving  skills  are 

a.  not  very  good. 

b.  about  average. 

c .  pretty  good . 

10.  How  do  you  feel  about  your  value  system? 

a.  I  haven't  really  thought  about  it. 

b.  I  have  areas  I  still  need  to  think  through. 

c.  I'm  not  sure  what  It  Is. 

d.  I  feel  comfortable  with  It. 

11.  Have  you  selected  a  career  goal? 

a.  Yes 

b.  No 

12.  What  Is  one  of  the  best  ways  to  handle  a  conflict  situation  with  another 
person? 

a.  Start  by  telling  them  "You  make  me  angry  when  you..." 

b.  Start  by  telling  them  "I  feel  angry  when  you..." 

c.  Ask  them  for  an  explanation  for  their  bahavlor. 

13.  One  of  the  best  ways  to  reduce  feelings  of  stress  Is  to 

a.  try  to  forget  about  or  avoid  the  stressful  situation. 

b.  think  about  the  stressful  situation  In  positive  ways. 

c.  accept  the  stressful  situation  as  a  normal  part  of  living. 

14.  Goal  setting 

a.  gives  people  a  technique  or  strategy  for  making  their  dreams  and 
ambitions  come  true. 

b.  gives  people  a  lot  of  trouble  because  It  Is  Impossible  to  plan  that 
far  Into  the  future. 

c.  gives  people  an  effective  method  for  dealing  with  their  personal  pro¬ 
blems  or  conflicts. 
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APPENDIX  C 

Recomnendatlons  for  Implementing  the  Student 
Motivational  Skill  Training  Package 


There  are  four  major  variables  that  need  to  be  addressed  by  anyone  who 
desires  to  Implement  the  Student  Motivational  Skill  Training  Package.  These 
variables  are: 

1.  The  role  of  organizational  change  In  a  successful  Implementa¬ 
tion  strategy; 

2.  The  role  of  the  Instructors  In  the  classroom  or  learning 
center  where  the  package  Is  to  be  Implemented; 

3.  The  role  of  group  process  In  the  success  of  the  training 
package; 

4.  The  role  of  the  peer  group  In  the  success  of  the  training 
package. 

Role  of  Organizational  Change.  Implementing  any  new  training  program 
Into  an  on-going  operational  organization  Is  essentially  an  exercise  In 
organizational  change.  Since  most  people  are»  at  least  Initially,  resistant 
to  change,  this  can  be  a  very  complex  task.  The  unlearning  of  old  and  familiar 
practices  and  the  relearning  of  new  ones  often  evokes  considerable  anxiety. 
Insecurity,  and  resistance  on  the  part  of  most  Individuals.  Given  these 
realities,  effective  organizational  change  necessitates  a  conscious  and 
deliberate  effort  on  the  part  of  the  change  agent  such  that  the  change  pro¬ 
cess  becomes  an  Integral  part  of  the  entire  program. 

After  a  review  of  educational  research  programs,  Fullan  and  Pomfret 
(1977,  p,  394)  conclude  that  "If  there  Is  one  finding  that  stands  out.  It 
Is  that  effective  Implementation  of  social  Innovations  requires  time,  per¬ 
sonal  Interaction  and  contacts.  In-service  training,  and  other  forms  of 
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people-based  support."  Hartley  (1979,  p.  53)  extends  this  concept  by  stating 
that,  "Although  a  project  can  benefit  from  the  whole-hearted  support  of  top 
officials  In  the  system,  resistance  will  be  less  and  change  Is  more  likely  to 
occur  If  those  affected  feel  that  the  project  Is  their  own— not  one  devised 
and  operated  by  outsiders.  Resistance  will  be  less  If  participants  have  joined 
In  diagnostic  efforts  leading  them  to  agree  on  what  the  basic  problem  Is  and 
to  feel  Its  Importance."  Diran's  (1978)  research  also  supports  this  approach 
and  his  data  reveal  that  system  acceptance  Is  more  likely  (a)  If  the  system  Is 
perceived  as  operating  In  the  Interests  of  various  constituencies  and  (b)  If 
these  constituencies  have  meaningful  Input  Into  the  design,  development,  and 
evaluation  of  the  program. 

An  approach  for  Implementing  the  Student  Skill  Motivational  Training 
Package  which  considers  the  role  of  organizational  change  would  possess  the 
following  characteristics:  (1)  decision-making  about  how  and  what  to  Imple¬ 
ment  takes  place  at  the  local  level;  (2)  Implementation  procedures  are  defined 
within  a  particular  context  rather  than  In  an  abstract,  theoretical,  or  Ideal 
manner  (Heck,  1980);  and  (3)  the  emphasis  Is  on  "establishing  acceptable  rules 
of  the  game  that  will  allow  multiple  participants  to  bargain  and  compromise 
during  the  course  of  Implementation"  (Berman,  1980,  p.  211).  Thus,  collabora¬ 
tion  with  practitioners  Is  the  core  of  this  approach  to  Implementation— an 
approach  which  Shavelson  (1981)  advocates  on  the  basis  that  It  will  also 
Improve  the  quality  of  research  underlying  an  operational  program.  This 
approach  also  Insures  that  programs  or  solutions  are  not  Imposed  by  outsiders. 
Gagne  (1980,  p.  5)  Indicates  that  one  of  the  characteristics  of  a  successful 


Implementation  program  of  which  he  was  a  part  was  that  "solutions  were  In  no 
way  Imposed  from  'outside'  or  'above,'"  The  type  of  power  that  an  Individual 
uses  to  bring  about  change  Is,  therefore,  critical  to  the  success  of  the 
Implementation, 

The  type  of  power  which  Is  most  detrimental  to  an  Implementation  process 
Is  one  of  positional  power— Implementing  change  through  direct  order.  Personal 
power  to  Influence  change  seems  to  be  much  more  appropriate  even  though  "the 
expediency  of  telling  or  ordering  change  seems  to  seduce  many  to  believe 
that  If  only  they  had  positional  power,  things  would  be  different  (and  better?)" 
(McGreevy,  1978,  p.  434),  The  role  of  the  researcher/ Implementer  would, 
accordingly,  be  one  of  a  stimulator  and  consultant,  not  the  director  or  the 
doer  (Klausmeler,  1981). 

Our  recommendations  for  Implementing  the  Student  Motivational  Skill 
Training  Package  would,  accordingly,  begin  with  the  Implementers  and  users 
(Instructors  and  supervisors)  coming  together  as  equals  and  designing  an 
Implementation  strategy  which  served  the  needs  of  each  of  the  participants. 

It  Is  our  experience  that  it  Is  Important  to  Include  the  supervisors  or 
managers  as  well  as  Instructors  on  the  Implementation  team  so  that  all  levels 
responsible  for  technical  training  understand  and  appreciate  the  new  procedures 
and  strategies  being  used  In  the  learning  centers  or  classrooms.  During  this 
first  stage  of  the  Implementation  process,  the  Implementers,  Instructors 
and  supervisors  establish  a  realistic  time  schedule  for  various  activities 
and  stages  In  the  Implementation  process  and  Identify  the  goals  of  the 
Implementation  strategy.  This  first  activity  would  be  called  the  conceptual¬ 
ization  stage. 
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The  next  step  In  the  Implementation  process  would  be  to  provide  each 
of  the  users  with  a  set  of  the  Student  Skills  Training  materials  such  that 
they  could  decide  where*  how,  and  to  what  extent  the  materials  needed  to  be 
modified,  revised  or  redirected  to  reflect  the  needs  of  the  user  and  his  or 
her  environment.  This  second  activity  would  be  called  the  Design  stage. 

The  third  implementation  activity  would  be  to  solicit  the  comments, 
suggestions,  and  criticisms  of  the  users  and  to  incorporate  them  into  a 
revised  Student  Motivational  Skill  Training  Package.  These  revised  materials 
would  then  be  submitted  to  the  users  to  assess  whether  or  not  the  changes 
they  suggested  were  made  appropriately  and  to  give  the  users  another  chance 
to  have  input  into  the  revisions  of  the  materials.  This  third  activity  would 
be  called  the  Development  stage. 

Once  a  set  of  revised  materials  that  both  the  users  and  the  implementers 
find  acceptable  has  been  achieved,  the  next  stage  would  be  to  subject  the 
revised  materials  to  a  formative  evaluation.  The  purpose  of  this  evaluation 
would  be  (a)  to  ascertain  the  degree  to  which  the  materials  achieved  the 
goals  they  were  designed  to  meet;  (b)  to  obtain  suggestions,  critiques,  and 
comments  from  the  students;  and  (c)  to  identify  any  confusing,  illogical,  or 
incorrect  Information  contained  within  the  materials.  On  the  basis  of  this 
Information  the  materials  would  once  again  be  revised.  It  is  Important  to 
note  that  durirn  formative  evaluation  the  Instructors  become  the  learning 
strategies  experts  and  Interface  with  the  students.  Instructors  provide  the 
selected  students  with  the  materials  being  evaluated,  answer  student  questions 
about  the  materials,  and  Insure  that  the  desired  feedback  from  students  is 
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The  next  stage  Is  to  establish  a  set  of  Evaluation  Plans.  These  plans 
would  Include  an  appropriate  evaluation  design,  a  time  schedule  for  various 
evaluation  activities,  the  Identification  of  specific  variables  to  be  assessed, 
the  definition  of  experimental  and  data  collection  activities,  the  Identifi¬ 
cation  of  Individuals  responsible  for  conducting  various  experimental  and  data 
collection  procedures,  and  the  Identification  of  specific  types  of  statistics 
to  be  used  In  the  analysis  of  evaluation  findings. 

After  a  thorough  evaluation  plan  has  been  developed,  the  sixth  stage  Is 
to  Implement  that  plan  and  carefully  monitor  It  throughout  the  Summative 
Evaluation  stage.  As  In  the  formative  evaluation.  Instructors  during  summative 
evaluation  become  the  learning  strategies  experts  and  learning  facilitators. 

They  Interface  with  students,  answering  their  questions,  guiding  them  In  the 
use  of  the  new  skills,  and  generally  fulfilling  their  normal  role  as  an  Instruc¬ 
tor  of  new  Information. 

When  the  summative  evaluation  has  been  completed  and  the  data  have  been 
analyzed.  It  Is  Imperative  for  the  Implementors  and  the  users  to  participate 
In  the  Follow-up  and  Transition  stage — to  discuss  the  results  and  on  the  basis 
of  these  data,  decide  whether  or  not  the  revised  Student  Motivational  Skill 
Training  Package  Is  achieving  the  goal  that  It  was  designed  to  meet.  If  It 
Is  not,  decisions  need  to  be  made  as  to  why  It  Is  not  achieving  these  goals 
and  what  the  team  of  Implementors  and  users  wants  to  do  about  this  Inadequacy. 
(See  Figure  1  for  a  summary  of  recommended  Implementation  stages.) 
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FIGURE  1 


Stages  in  the  Recoitmended  Implejnentatlon  Strategy  for  the 
CMI  Instructor  Role  Training  Package 
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Role  of  Instructors.  The  Instructor's  role  In  the  Implementation  process 
Is  one  of  teammate  on  the  Implementation  team  as  well  as  learning  strategies 
expert  during  the  formative  and  summative  evaluations.  With  respect  to  the 
latter  responsibility,  there  are  six  different  ways  In  which  Instructors  can 
help  students  acquire  and  maintain  new  skills: 

First,  Instructors  can  help  students  apply  the  new  skills  to  new 
situations;  demonstrate  new  applications;  and  provide  new  and  different 
examples. 

Second,  instructors  can  model  the  new  skills,  showing  students  how 
they,  as  instructors,  apply.  Implement,  and  make  use  of  the  new  skills. 

Third,  Instructors  can  remind  students  of  how  and  when  to  use  the  new 
skills  In  new  situations.  They  can  also  Increase  the  amount  of  practice 
that  students  experience  In  using  these  new  skills  by  creating  new  situations 
which  call  for  the  use  of  these  skills. 

Fourth,  Instructors  can  monitor  the  progress  charts  or  maintenance 
charts  that  students  are  required  to  keep  as  part  of  the  skill  training. 

This  Insures  not  only  that  the  students  maintain  these  charts,  but  also 
allows  the  Instructors  to  provide  Individual  guidance  to  those  students  who 
need  additional  assistance  In  understanding  and  applying  the  new  skills,  or 
maintaining  the  charts. 
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Fifth,  Instructors  can  provide  a  very  effective  and  consistent  reward 
system  for  students  participating  In  the  new  program.  Again,  personal  con¬ 
tact  Is  a  strong  force  and  can  be  used  by  Instructors  to  motivate  students. 

Finally,  Instructors  can  make  the  new  skills  to  be  learned  enjoyable, 
entertaining,  and  even  profitable  for  their  students.  By  calling  out  the 
unusual,  the  humorous,  or  even  the  "sexy"  aspects  of  the  new  skills,  in¬ 
structors  can  help  students  easily  and  quickly  remember  the  new  skills. 

Role  of  Group  Process.  Another  variable  which  appears  to  contribute 
to  the  success  of  the  Implementation  of  the  Student  Motivational  Skill  Train¬ 
ing  Package  Is  the  role  of  group  process.  The  group  training  experience  and. 
In  particular,  the  group  discussions  which  are  part  of  the  training,  seem 
to  be  very  Important  for  helping  students  clarify,  understand,  and  apply  new 
skills  presented  In  this  package.  The  Instructors*  responsibilities  In  these 
groups  are  not  those  of  lecturer  or  dispenser  of  Information,  but  rather  those 
of  group  facilitator,  clarifier,  and  promoter  of  communication  between  stu¬ 
dents,  In  this  situation,  the  Instructors'  use  of  active  listening  and  clari¬ 
fying  statements  Is  critical  for  effective  perfoimance  as  group  leaders. 

For  the  student,  the  group  discussions  can  become  a  place  where  they  can 
role-play  and  practice  specific  new  skills  and  behaviors.  Students  also  have 
the  opportunity  to  share  with  each  other  some  of  their  feelings,  opinions, 
beliefs,  and  uncertainties,  and  this  In  turn  helps  them  realize  that  they  are 
not  the  only  ones  experiencing  confusions  aid  uncertainty  In  various  aspect* 
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of  their  lives.  In  general,  then,  group  process  provides  the  function  of 
enhancing,  and  allowing  students  to  elaborate  on  and  refine,  skills  and 
strategies  learned  in  the  self-instructional  skill  training  package. 

Role  of  the  Peer  Group.  The  sharing  of  feelings  and  beliefs  with  their 
peers  leads  to  the  formation  of  a  peer  group— a  group  that  can  meet  some  of 
the  social  and  belongingness  needs  of  the  technical  training  student.  Meeting 
these  needs  is  important,  particularly  in  training  situations  where  students 
don't  know  each  other  and/or  where  students  are  required  to  adapt  to  a  variety 
of  novel  requirements.  Our  experience  is  that  this  peer  group  can  have  a 
positive  effect  on  learning  strategies  skill  training  such  as  the  Student 
Motivational  Skill  Training  Package.  Students  can  help  each  other  see  the 
need  for  and  value  of  new  skills  and  strategies,  as  well  as  help  each  other 
maintain  the  skills  and  implement  the  new  behaviors.  Students  can  help  each 
other  when  they  get  discouraged  or  forget  to  use  their  new  skills  and  by  so 
doing,  the  student  peer  group  can  be  a  very  effective  skill  maintenance 
tool . 


Although  this  approach  to  Implementation  may  seem  to  Involve  a  great 
deal  of  effort,  it  is  our  experience  that  tailoring  a  set  of  materials  to 
the  specifics  of  an  environment  and  doing  this  tailoring  via  a  team  approach 
with  the  implementers  and  the  users  coming  together  as  equals,  each  of  whom 
has  his  or  her  unique  expertise  to  contribute  to  the  team,  is  an  approach 
which  is  much  more  likely  to  result  in  a  successful  implementation  than  a 
more  direct,  positional  power  oriented  approach.  That  is  not  to  say  that 


this  approach  is  without  Its  problems  (e.g..  It  Is  time-consuming.  It  requires 
that  the  researcher  possess  good  human  relations  and  communication  skills). 

This  Is  only  to  say  that  If  the  goal  is  to  Implement  the  Student  Motivational 
Skill  Training  Package,  or  any  other  such  Innovation,  and  to  maximize  Its 
effects,  this  team  approach  to  the  process  Is  the  strategy  most  likely  to 
minimize  conflict  and  stress  and  maximize  the  positive  effects  of  the  new 
package. 
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